-- Logs begin at Wed 2022-09-28 07:58:15 UTC, end at Wed 2022-09-28 09:04:23 UTC. -- Sep 28 08:29:29.688074 dv-cinder-844563-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 08:29:29.696969 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 08:29:29 2022] *** Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: nodename: dv-cinder-844563-8-iscsi Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: machine: x86_64 Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: clock source: unix Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: pcre jit disabled Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: detected number of CPU cores: 4 Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: current working directory: / Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: detected binary path: /usr/bin/uwsgi-core Sep 28 08:29:29.699530 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: your processes number limit is 47680 Sep 28 08:29:29.700257 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: your memory page size is 4096 bytes Sep 28 08:29:29.700257 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: detected max file descriptor number: 2048 Sep 28 08:29:29.700257 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: lock engine: pthread robust mutexes Sep 28 08:29:29.700257 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: thunder lock: enabled Sep 28 08:29:29.700257 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 08:29:29.700257 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 08:29:29.741435 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: Python main interpreter initialized at 0x5616959449c0 Sep 28 08:29:29.741435 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: python threads support enabled Sep 28 08:29:29.741435 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: your server socket listen backlog is limited to 100 connections Sep 28 08:29:29.741435 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: your mercy for graceful operations on workers is 90 seconds Sep 28 08:29:29.741859 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 08:29:29.741859 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: *** Operational MODE: preforking *** Sep 28 08:29:29.742133 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: *** uWSGI is running in multiple interpreter mode *** Sep 28 08:29:29.742133 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: spawned uWSGI master process (pid: 105690) Sep 28 08:29:29.742349 dv-cinder-844563-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 08:29:29.745115 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: spawned uWSGI worker 1 (pid: 105691, cores: 1) Sep 28 08:29:29.745115 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: spawned uWSGI worker 2 (pid: 105692, cores: 1) Sep 28 08:29:29.745115 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 08:29:30.406446 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 08:29:30.408574 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 08:29:31.518542 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:29:31.518542 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: from cryptography.utils import int_from_bytes Sep 28 08:29:31.519210 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:29:31.519210 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: from cryptography.utils import int_from_bytes Sep 28 08:29:31.520440 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:29:31.520440 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: from cryptography.utils import int_from_bytes Sep 28 08:29:31.520921 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:29:31.520921 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: from cryptography.utils import int_from_bytes Sep 28 08:29:34.019859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 08:29:34.020510 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 08:29:34.020867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 08:29:34.020955 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 08:29:34.021043 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 08:29:34.021156 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 08:29:34.021238 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 08:29:34.021335 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 08:29:34.021422 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 08:29:34.021500 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 08:29:34.021641 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.021735 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.021971 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.022068 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.022294 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.022380 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.022613 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.022711 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.022946 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.023040 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.023256 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.023340 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.023576 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.023674 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.023895 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.023986 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.024223 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.024307 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.024483 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.024575 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.024801 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.024898 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.025146 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-8-iscsi {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.025250 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-8-iscsi {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.025475 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.025607 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.025782 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.025865 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.026614 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.026743 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.026935 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.027029 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.027242 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.027333 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.027565 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.027649 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.027872 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.027964 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.028371 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.028471 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.028822 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.028973 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.029172 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.029284 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.029461 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.029553 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.029801 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.029912 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.030115 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.030215 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.030690 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.030788 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.031012 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.031112 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.031323 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.031421 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.031647 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.031741 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.031956 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.032047 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.032354 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-8-iscsi {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.032450 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-8-iscsi {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.032672 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.032757 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.032986 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.033084 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.033326 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.033430 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.033744 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.033928 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.034056 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.034141 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.034366 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.034459 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.034689 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.034785 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.035015 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.035099 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.035326 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.035424 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.035656 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.035781 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.035991 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.036086 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.036296 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.036390 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.036617 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.036724 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.036921 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.037013 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.037253 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.037376 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.037565 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.037661 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.037885 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.037971 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.038189 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.038273 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.038493 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.038579 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.038744 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.038834 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.039054 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.039147 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.039376 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.039463 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.039699 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.039782 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040021 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040139 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040274 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040360 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040522 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040615 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040843 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.040941 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.041188 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.041280 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.041501 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.041636 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.042353 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.042439 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.042663 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.042748 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.042971 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.043102 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.043278 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.043364 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.043589 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.043674 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.043899 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.043982 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.044207 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.044291 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.044527 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.044610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.044845 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.044944 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.045189 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.045288 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.045503 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.045587 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.045826 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.045919 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.046227 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.046311 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.046479 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.046563 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.046788 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.046884 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.047128 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.047217 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.047447 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.047533 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.047755 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.047849 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.048076 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.048168 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.048398 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.048489 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.048708 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.048802 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.049017 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.049135 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.049351 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.049444 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.049671 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.049763 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050005 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050090 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050311 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050394 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050563 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050649 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050864 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.050948 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.051169 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.051262 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.051489 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.051574 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.051796 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.051880 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.052104 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.052189 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.052410 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.052495 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.052710 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.052794 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.053016 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.053128 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.053348 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.053435 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.053659 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.053747 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.053964 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.054056 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.054270 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.054353 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.054577 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.054681 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.054881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.054976 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.055188 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.055272 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.055493 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.055637 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.055798 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.055926 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.056116 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.056202 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.056437 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.056531 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.056742 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.056845 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.057047 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.057151 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.057402 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.057489 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.057709 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.057803 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.058028 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.058113 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.058334 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.058418 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.058639 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.058731 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.058961 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.059045 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.059266 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.059350 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.059572 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.059669 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.059891 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.059976 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.060199 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.060291 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.060504 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.060673 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.060823 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.060908 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.061140 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.061228 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.061454 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.061540 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.061773 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.061857 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.062081 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.062164 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.062387 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.062479 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.062690 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.062773 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.062995 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.063079 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.063299 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.063385 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.063607 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.063707 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.063911 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.064004 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.064222 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.064338 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.064521 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.064626 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.064842 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.064946 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.065187 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.065281 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.065500 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.065609 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.065810 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.065937 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.066117 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.066208 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.066437 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.066529 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:29:34.066776 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.066879 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.067128 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.067221 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.067454 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.067554 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.067771 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.067871 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.068105 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.068205 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.068438 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.068536 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.068757 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.068858 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.069071 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.069178 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.069410 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.069514 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.069736 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.069821 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.070049 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.070154 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.070364 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.070459 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.070674 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.070758 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.070993 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.071097 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.071311 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.071396 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.071642 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.071726 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.071959 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.072044 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.072278 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.072360 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.072597 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.072683 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.072938 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.073026 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.073291 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.073626 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.073728 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.073949 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.074265 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.074356 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.074613 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.074707 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.074964 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.075050 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.075282 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.075367 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.075612 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.075706 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.075938 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.076030 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.076253 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.076352 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.076566 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.076662 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.076880 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.076964 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.077219 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.077307 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.077538 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.077624 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.077849 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.077941 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.078170 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.078256 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.078486 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.078571 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.078805 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.078888 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.079118 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.079201 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.079432 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.079525 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.079746 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.079830 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.080058 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.080151 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.080374 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.080543 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.080686 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.080823 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.080966 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.081127 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.081334 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.081469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.081651 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.081782 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.081968 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.082115 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.082284 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.082424 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.082595 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.082730 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.082906 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.083050 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.083213 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.083350 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.083513 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.083669 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.083821 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.083992 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.084128 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.084213 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.084435 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.084522 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.084741 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.084836 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.085054 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.085193 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.085383 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.085469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.085705 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.085793 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.086035 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.086125 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.086342 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.086430 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.086657 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.086746 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.086968 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.087054 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.087278 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.087364 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.087587 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.087684 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.087895 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.087980 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.088204 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.088290 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.089022 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.089146 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.089381 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.089471 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.089696 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.089792 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.090004 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.090099 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.090331 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.090417 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.090636 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.090738 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.090943 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.091038 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.091258 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.091343 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.091569 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.091668 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.091888 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.091982 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.092193 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.092277 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.092503 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.092600 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.092818 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.092904 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.093151 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.093290 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.093467 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.093866 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.094135 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.094442 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.094768 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.095099 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.095198 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.095418 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.095504 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.095725 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.095823 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.096039 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.096176 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.096345 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.096433 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.096650 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.096736 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.096956 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.097051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.097291 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.097391 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.097596 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.097707 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.097901 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.098018 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.098206 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.098338 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.098511 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.098651 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.098816 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.098963 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.099141 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.099274 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.099452 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.099589 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.099757 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.099896 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.100062 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.100205 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.100366 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.100511 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.100709 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.100825 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.101015 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.101151 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.101399 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.101502 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.101739 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.101824 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.102059 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.102144 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.102362 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.102455 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.102669 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.102756 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.102991 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.103075 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.103307 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.103410 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.103621 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.103707 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.105052 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.105260 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.105411 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.105589 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.105746 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.105900 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.106853 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.106946 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.107026 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.107115 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.107203 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.107288 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.107588 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.107764 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.107939 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.108068 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.108275 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.108398 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.108595 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.108734 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.108927 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.109060 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.109321 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.109419 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.109670 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.109763 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.109999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.110091 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.110334 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.110433 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.110654 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.110754 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.110981 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.111702 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.111794 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.111873 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.111957 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112048 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112128 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112204 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112280 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112392 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112515 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112730 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.112817 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.113050 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.113162 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.113396 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.113493 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.113715 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.113814 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.114031 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.114173 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.114348 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.114435 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.114665 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.114751 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.114982 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.115074 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.115294 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.115378 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.115624 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.115716 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.115932 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.116017 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.116246 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.116413 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.116560 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.116651 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.116870 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.116955 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.117205 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.117310 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.117526 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.117643 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.117836 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.117943 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.118142 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.118241 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.118458 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.118544 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.118776 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.118861 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.119089 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.119189 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.119403 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.119496 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.119737 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.119823 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.120054 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.120147 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.120366 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.120452 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.120672 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.120825 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.120981 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.121106 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.121322 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.121408 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.121638 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.121723 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.121953 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.122039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.122261 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.122352 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.122581 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.122668 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.122890 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.122976 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.123197 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.123285 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.123505 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.123599 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.123821 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.123914 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.124127 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.124259 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.124437 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.124535 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.124745 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.124830 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.125078 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.125194 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.125409 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.125511 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.125719 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.125803 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.126041 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.126134 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.126356 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.126452 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.126667 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.126760 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.126979 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.127073 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.127287 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.127381 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.127664 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.127802 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.127921 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.128020 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.128240 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.128388 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.128554 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.128719 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.128868 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.129047 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.129219 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.129386 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.129508 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.129703 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.129824 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.130019 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.130150 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.130336 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.130464 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.130665 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.130777 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.130990 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.131076 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.131306 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.131400 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.131619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.131704 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.131933 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.132026 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.132246 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.132558 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.132651 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.132884 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.132981 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.133219 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.133324 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.133536 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.133622 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.133850 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.133944 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.134156 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.134255 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.134471 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.134560 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.134792 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.134877 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.135146 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.135390 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.135490 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.135729 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.135822 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.136047 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.136141 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.136419 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.136518 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.136683 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.136767 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.136997 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.137118 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.137335 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.137425 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141060 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141239 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141341 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141435 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141505 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141583 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141660 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141746 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141826 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.141915 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.142820 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.142921 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143010 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143096 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143182 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143272 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143352 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143429 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143505 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143581 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143655 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143802 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143884 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.143961 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144038 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144114 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144204 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144283 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144360 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144484 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144578 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144659 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144746 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144833 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144833 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.144975 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145052 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145153 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145251 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145333 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145410 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145487 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145571 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145656 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145744 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145824 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145898 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.145983 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146062 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146147 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146226 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146302 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146378 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146454 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146531 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146620 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146703 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146788 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146873 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.146873 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.147028 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.147112 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.147389 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.147476 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.147700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.148009 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.148093 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.148324 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.148619 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.148705 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.148962 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.149260 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.149368 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.149587 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.149847 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.149933 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.150215 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.152633 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.152938 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153025 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153166 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153262 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153342 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153419 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153504 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153594 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153672 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153756 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153843 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.153920 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154005 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154090 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154090 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154236 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154236 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154384 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154478 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154554 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154619 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.154827 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.155065 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.155162 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.155716 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.155913 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.156048 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.156368 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.156515 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.156681 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.156993 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.157085 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.157456 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.157564 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.157780 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.158087 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.158180 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.158404 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.158661 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.158746 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.159034 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.159254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.159339 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.159668 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.159870 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.159988 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.160451 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.160543 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.160668 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.161002 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.161155 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.161413 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.161511 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.161776 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.161997 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.162083 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.162392 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.162575 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.162733 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.163059 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.163159 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.163373 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.163692 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.163798 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.164007 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.164328 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.164424 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.164681 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.164781 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.165065 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.165338 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.165440 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.165745 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.165930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.166074 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.166393 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.166495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.167273 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.167524 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.167612 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171167 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171298 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171392 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171473 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171550 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171627 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171702 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171796 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171906 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.171992 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172083 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172163 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172251 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172332 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172409 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172485 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172563 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172682 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172777 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172873 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.172951 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173027 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173124 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173205 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173296 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173376 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173453 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173538 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173618 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173708 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173794 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173872 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.173976 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174055 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174131 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174215 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174294 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174378 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174456 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174532 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174609 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174694 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174776 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174843 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174919 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.174997 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.175073 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.175230 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.175373 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.175486 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.175695 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.175793 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.176011 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.176116 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.176328 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.176422 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.176644 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.176738 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.176959 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.177055 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.177302 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.177424 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.177614 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.177761 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.177925 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.178056 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.178237 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.178365 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.178548 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.178676 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.178859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.179000 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.179171 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.179300 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.179485 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.179615 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.179792 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.179920 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.180107 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.180242 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.180412 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.180553 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.180723 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.180861 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.181032 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.181150 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.181386 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.181522 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.181700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.181843 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.182009 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.182182 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.182351 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.182492 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.182660 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.182806 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.182974 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.183122 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.183283 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.183441 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.183724 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.183810 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.184039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.184126 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.184354 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.184463 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.184661 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.184780 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.184975 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.185120 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.185314 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.185500 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.185634 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.185748 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.185952 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.186058 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.186260 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.186372 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.186687 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.186774 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.186995 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.187079 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.187303 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.187390 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.187610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.187695 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.187919 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.188019 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.188226 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.188313 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.188542 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.188627 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.188873 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.188976 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.189204 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.189295 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.189515 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.189600 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.189829 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.190007 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.190157 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.190325 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.190466 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.190639 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.190791 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.190968 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.191218 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.191303 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.191538 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.191624 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.191850 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.191984 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.192209 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.192310 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.192521 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.192609 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.192850 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.192940 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.193202 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.193292 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.193523 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.193621 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.193846 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.193939 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.194157 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.194249 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.194476 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.194563 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.194790 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.194875 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.195109 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.195201 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.195435 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.195521 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.195751 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.195862 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.196074 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.196194 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.196383 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.196510 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.196711 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.196834 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.197039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.197189 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.197381 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.197502 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.197708 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.198337 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.198655 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.198743 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.199020 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.199127 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.199272 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.199367 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.199599 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.199685 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.199912 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.200006 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.200228 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.200322 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.200538 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.200623 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.200849 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.200938 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.201227 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.201325 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.201486 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.201572 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.201810 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.201901 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.202148 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.202250 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.202432 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.202516 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.202746 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.202830 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.203059 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.203145 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.203368 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.203460 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.203677 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.203768 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.204001 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.204087 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.204306 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.204396 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.204613 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.204706 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.204922 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.205008 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.205257 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.205346 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.205589 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.205685 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.205901 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.205994 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.206227 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.206312 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.206543 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.206637 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.206853 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.206939 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.207161 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.207248 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.207470 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.207564 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.207819 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.207913 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.208129 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.208216 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.208442 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.208528 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.208766 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.208851 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.209200 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.209299 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.209436 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.209525 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.209748 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.209833 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.210065 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.210161 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.210376 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.210463 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.210684 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.210769 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.210996 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.211094 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.211311 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.211400 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.211620 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.211706 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.211929 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.212025 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.212234 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.212321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.212541 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.212625 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.212852 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.212950 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.213207 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.213301 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.214067 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.214164 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.214378 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.214478 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.214690 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.214777 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.214999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.215084 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.215352 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.215445 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.215663 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.215755 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.215992 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.216084 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.216310 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.216398 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.216625 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.216710 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.216939 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.217023 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.217272 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.217374 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.217594 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.217681 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.217918 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.218024 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.218237 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.218324 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.218554 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.218637 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.218871 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.218968 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.219188 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.219277 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.219509 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.219597 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.219836 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.219994 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.220158 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.220298 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.220473 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.220726 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.220907 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.221061 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.221203 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.221406 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.221496 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.221724 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.221809 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.222041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.222127 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.222360 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.222447 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.222678 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.222919 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.223007 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.223258 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.223358 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.223581 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.223668 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.223899 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.223986 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.224216 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.224307 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.224538 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.224624 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.224859 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.224945 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.225205 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.225332 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.225525 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.225624 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.225840 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.225967 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.226154 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.226239 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.226468 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.226561 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.226801 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.226895 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.227136 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.227239 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.227442 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.227528 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.227759 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.227845 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.228079 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.228164 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.228395 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.228480 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.228707 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.228791 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.229046 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.229156 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.229390 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.229478 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.229708 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.229792 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.230025 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.230128 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.230343 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.230429 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.230659 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.230760 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.230972 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.231139 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.231285 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.231371 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.231603 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.231688 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.231919 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.232017 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.232234 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.232360 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.232548 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.232633 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.232862 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.232948 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.233219 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.233420 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.233532 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.233744 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.233874 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.234085 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.234201 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.234420 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.234505 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.234751 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.234849 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.235076 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.235168 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.235398 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.235636 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.235729 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.235957 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.236078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.236295 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.236387 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.236627 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.236721 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.236943 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.237027 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.237278 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.237366 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.237597 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.237691 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.237913 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.237998 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.238224 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.238315 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.238529 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.238627 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.238846 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.238943 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.239167 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.239380 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.239473 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.239733 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.239821 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.240053 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.240138 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.240383 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.240474 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.240708 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.240801 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.241019 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.241129 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.241356 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.241580 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.241688 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.241930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.242028 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.242251 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.242338 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.242581 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.242671 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.242899 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.242984 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.243207 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.243301 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.243516 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.243601 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.243830 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.243915 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.244141 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.244238 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.244447 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.244539 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.244786 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.244871 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.245138 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.245240 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.245424 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.245544 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.245734 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.245820 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.246043 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.246137 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.246351 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.246445 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.246655 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.246738 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.246959 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.247052 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.247263 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.247347 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.247566 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.247649 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.247872 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.247959 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.248186 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.248281 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.248487 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.248572 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.248798 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.248886 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.249139 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.249241 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.249460 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.249554 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.249775 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.249905 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.250084 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.250185 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.250400 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.250507 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.250708 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.250803 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.251020 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.251123 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.251325 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.251431 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.251638 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.251740 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.251950 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.252044 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.252278 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.252383 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.252595 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.252698 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.252905 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.252992 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.253243 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.253343 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.253555 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.253641 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.253872 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.254124 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.254218 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.254476 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.254605 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.254787 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.254873 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.255103 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.255196 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.255447 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.255547 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.255760 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.255855 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.256074 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.256293 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.256380 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.256630 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.256715 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.256954 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.257039 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.257315 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.257406 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.257632 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.257729 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.257948 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.258047 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.258257 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.258341 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.258568 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.258655 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.258879 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.258972 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.259192 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.259278 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.259504 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.259598 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.259815 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.259968 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.260125 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.260210 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.260953 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.261053 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.261293 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.261384 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.261606 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.261691 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.261917 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.262004 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.262230 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.262318 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.262541 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.262683 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.262855 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.262943 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.263165 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.263253 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.263477 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.263570 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.263788 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.263883 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.264098 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.264183 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.264412 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.264497 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.264725 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.264820 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.265044 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.265163 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.265384 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.265470 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.265705 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.265800 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.266012 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.266098 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.266322 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.266633 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.266720 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.266945 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.267032 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.267261 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.267346 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.267594 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.267692 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.267910 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.267996 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.268218 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.268304 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.268591 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.268910 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.268995 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.269252 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.269340 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.269567 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.269651 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.269948 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.270091 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.270220 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.270306 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.270548 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.270642 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.270873 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.270959 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.271183 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.271267 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.271492 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.271586 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.271801 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.271888 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.272114 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.272210 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.272436 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.272529 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.272776 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.272875 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.273050 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.273181 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.273382 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.273470 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.273696 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.273790 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.274001 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.274093 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.274306 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.274392 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.274613 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.274706 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.274919 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.275052 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.275223 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.275309 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.275525 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.275609 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.275831 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.275946 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.276679 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.276818 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.276995 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.277112 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.277326 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.277426 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.277630 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.277722 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.277939 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.278024 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.278241 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.278333 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.278548 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.278640 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.278849 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.278933 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.279153 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.279246 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.279456 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.279548 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.279757 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.279841 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.280065 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.280207 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.280635 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.280723 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.280941 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.281026 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.281269 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.281365 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.281574 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.281660 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.281878 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.281964 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.282218 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.282328 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.282545 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.282640 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.282881 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.282978 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.283172 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.283263 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.283483 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.283567 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.283810 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.283906 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.284123 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.284436 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.284528 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.284753 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.284849 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.285066 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.285188 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.285402 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.285488 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.285732 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.285816 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.286060 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.286147 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.286370 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.286462 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.286683 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.286768 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.287001 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.287091 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.287315 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.287407 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.287631 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.287732 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.287940 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.288026 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.288270 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.288355 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.288580 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.288674 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.288894 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.288979 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.289234 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.289340 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.289548 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.289643 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.289862 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.289955 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.290183 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.290278 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.290501 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.290590 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.290790 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.290878 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.291111 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.291197 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.291422 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.291530 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.291764 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.291850 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.292078 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.292164 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.292393 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.292482 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.292711 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.292797 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.293027 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.293170 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.293367 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.293463 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.293687 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.293780 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.294006 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.294102 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.294338 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.294424 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.294654 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.294740 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.294967 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.295063 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.295273 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.295359 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.295519 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 08:29:34.295606 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.295948 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.296266 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.296612 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.296946 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.297287 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.297603 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.297910 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:29:34.298155 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 08:29:34.448882 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO dbcounter [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Registered counter for database nova_api Sep 28 08:29:34.451440 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO dbcounter [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Registered counter for database nova_api Sep 28 08:29:34.469585 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_db.sqlalchemy.engines [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.471783 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_db.sqlalchemy.engines [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.476270 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writer thread running {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:34.478443 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writer thread running {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:34.534400 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.context [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e2a57ab-fab2-4986-9c64-da0c4216fc01(cell1) {{(pid=105692) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 08:29:34.536061 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.context [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e2a57ab-fab2-4986-9c64-da0c4216fc01(cell1) {{(pid=105691) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 08:29:34.538371 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:29:34.538853 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:29:34.539947 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_concurrency.lockutils [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:29:34.540418 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:29:34.540510 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_concurrency.lockutils [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:29:34.541190 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:29:34.541692 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:29:34.542054 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_concurrency.lockutils [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:29:34.542782 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_concurrency.lockutils [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:29:34.543236 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_concurrency.lockutils [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:29:34.543674 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:29:34.545273 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_concurrency.lockutils [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:29:34.545701 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO dbcounter [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Registered counter for database nova_cell0 Sep 28 08:29:34.547266 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO dbcounter [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Registered counter for database nova_cell0 Sep 28 08:29:34.549760 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO dbcounter [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Registered counter for database nova_cell1 Sep 28 08:29:34.551252 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO dbcounter [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Registered counter for database nova_cell1 Sep 28 08:29:34.557675 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_db.sqlalchemy.engines [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.560745 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_db.sqlalchemy.engines [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.560884 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_db.sqlalchemy.engines [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.564083 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_db.sqlalchemy.engines [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.568008 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writer thread running {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:34.569501 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writer thread running {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:34.570607 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writer thread running {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:34.573320 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writer thread running {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:34.717260 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO dbcounter [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Registered counter for database nova_cell0 Sep 28 08:29:34.718719 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO dbcounter [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Registered counter for database nova_cell0 Sep 28 08:29:34.726363 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_db.sqlalchemy.engines [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.730109 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG oslo_db.sqlalchemy.engines [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:29:34.731696 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writer thread running {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:34.734967 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writer thread running {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:29:35.082656 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: WARNING keystonemiddleware.auth_token [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:29:35.084867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: WARNING keystonemiddleware.auth_token [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:29:35.090111 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: WARNING keystonemiddleware.auth_token [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:29:35.092243 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: WARNING keystonemiddleware.auth_token [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:29:35.434510 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: WARNING keystonemiddleware.auth_token [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:29:35.437527 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: WARNING keystonemiddleware.auth_token [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:29:35.440437 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: WARNING keystonemiddleware.auth_token [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:29:35.443483 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: WARNING keystonemiddleware.auth_token [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:29:35.445782 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616959449c0 pid: 105691 (default app) Sep 28 08:29:35.447955 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:29:35.448944 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616959449c0 pid: 105692 (default app) Sep 28 08:29:35.449204 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-d622b028-814b-4d65-bd11-9ff06f726dd1 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001867 Sep 28 08:29:35.449618 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Sep 28 08:29:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:30:58.308715 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:30:58.311000 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003368 Sep 28 08:30:58.311739 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:30:58.323855 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_api:SELECT=3 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:58.324774 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_cell1:SELECT=3 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:58.327322 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_cell0:SELECT=3 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:58.328205 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:30:59.224395 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-867867bc-f338-4363-b065-af4f3ff5c9e2 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:30:59.257250 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-867867bc-f338-4363-b065-af4f3ff5c9e2 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939092 Sep 28 08:30:59.258055 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 08:30:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:01.909482 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:01.910951 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-199a5fe5-0fbe-40b1-9204-21b52e05e568 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 28 08:31:01.912764 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:02.394677 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-a2d641ee-4daf-47e8-970b-e0cb4ea0b1b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256"}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:02.442585 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-a2d641ee-4daf-47e8-970b-e0cb4ea0b1b0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.524832 Sep 28 08:31:02.443153 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:02.457872 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_api:SELECT=3 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:02.458769 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_cell0:SELECT=3 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:02.460769 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_cell1:SELECT=3 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:02.461711 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:02.678215 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-c1196a6e-d148-4a71-bc54-7740df42581c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:02.747819 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-c1196a6e-d148-4a71-bc54-7740df42581c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295216 Sep 28 08:31:02.748469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 08:31:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:05.398235 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-a2d641ee-4daf-47e8-970b-e0cb4ea0b1b0 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:05.399311 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-a2d641ee-4daf-47e8-970b-e0cb4ea0b1b0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 28 08:31:05.399713 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:06.079411 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-de12753a-9c5e-4f37-b8a2-627c160c90a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "swap": 0}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:06.123736 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-de12753a-9c5e-4f37-b8a2-627c160c90a2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717723 Sep 28 08:31:06.124638 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:06.137658 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-dce7f05e-d5e2-4def-a8bf-38f766d07493 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:06.182941 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-dce7f05e-d5e2-4def-a8bf-38f766d07493 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049845 Sep 28 08:31:06.185141 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 08:31:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:31:08.829879 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-de12753a-9c5e-4f37-b8a2-627c160c90a2 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:08.830904 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-de12753a-9c5e-4f37-b8a2-627c160c90a2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 28 08:31:08.831321 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:09.261141 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-b187d00a-172a-40c6-bc08-c701eb1ff5b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2"}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:09.283980 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-b187d00a-172a-40c6-bc08-c701eb1ff5b3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445438 Sep 28 08:31:09.284726 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:09.297474 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-4a00aef6-7a09-43a2-8e85-58084eb29578 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:09.327169 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-4a00aef6-7a09-43a2-8e85-58084eb29578 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033355 Sep 28 08:31:09.327762 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 08:31:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:11.988274 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-b187d00a-172a-40c6-bc08-c701eb1ff5b3 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:11.989316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-b187d00a-172a-40c6-bc08-c701eb1ff5b3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 28 08:31:11.989711 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:12.434821 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-c41b6e53-8b52-4e65-a5e4-3cc4e83e5d65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:12.454824 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-c41b6e53-8b52-4e65-a5e4-3cc4e83e5d65 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457591 Sep 28 08:31:12.455560 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 08:31:12.467298 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-313b9314-20b7-440b-8f3b-0d1c06087a40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:12.497833 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-313b9314-20b7-440b-8f3b-0d1c06087a40 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034162 Sep 28 08:31:12.498689 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 08:31:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:31:15.170460 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-c41b6e53-8b52-4e65-a5e4-3cc4e83e5d65 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:15.171470 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-c41b6e53-8b52-4e65-a5e4-3cc4e83e5d65 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 28 08:31:15.171870 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:15.614106 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-12f078b3-e64e-4a32-a4c2-bec5de55e474 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "name": "ds4G", "swap": 0, "id": "d4", "disk": 20}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:15.634647 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-12f078b3-e64e-4a32-a4c2-bec5de55e474 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456423 Sep 28 08:31:15.635208 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:15.647369 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-1e0c481d-335f-4464-9aaa-b014c4c0b581 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:15.673174 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-1e0c481d-335f-4464-9aaa-b014c4c0b581 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029450 Sep 28 08:31:15.673756 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Sep 28 08:31:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:18.588405 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-12f078b3-e64e-4a32-a4c2-bec5de55e474 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:18.589885 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-12f078b3-e64e-4a32-a4c2-bec5de55e474 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Sep 28 08:31:18.590411 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:19.046353 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-eae97af8-9c69-431d-ae8a-c1d782624913 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:19.073386 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-eae97af8-9c69-431d-ae8a-c1d782624913 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.474560 Sep 28 08:31:19.074108 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 08:31:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:31:21.717779 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-12f078b3-e64e-4a32-a4c2-bec5de55e474 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:21.718827 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-12f078b3-e64e-4a32-a4c2-bec5de55e474 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 28 08:31:21.719242 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:22.148004 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-5cc9c266-9c90-45d1-82a2-e7f327e8c825 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:22.170998 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-5cc9c266-9c90-45d1-82a2-e7f327e8c825 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.444943 Sep 28 08:31:22.171556 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 08:31:22.183792 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-eca32615-6017-4791-ab93-87430a02033d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:22.217782 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-eca32615-6017-4791-ab93-87430a02033d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037686 Sep 28 08:31:22.218370 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 08:31:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:24.894803 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-5cc9c266-9c90-45d1-82a2-e7f327e8c825 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:24.895820 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-5cc9c266-9c90-45d1-82a2-e7f327e8c825 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 28 08:31:24.896230 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:25.336161 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-cc3b9763-aa1b-42c8-aaf9-23691596f933 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:25.356318 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-cc3b9763-aa1b-42c8-aaf9-23691596f933 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453130 Sep 28 08:31:25.361147 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:25.371784 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-d927fa76-0f56-4e2f-85bb-afea867e47bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:25.402014 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-d927fa76-0f56-4e2f-85bb-afea867e47bc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035385 Sep 28 08:31:25.402616 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 08:31:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:28.080525 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-cc3b9763-aa1b-42c8-aaf9-23691596f933 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:28.081624 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-cc3b9763-aa1b-42c8-aaf9-23691596f933 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 28 08:31:28.082186 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:31:28.566383 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-314cdf80-698f-4842-a80d-3ddaf4009f3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:28.588604 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-314cdf80-698f-4842-a80d-3ddaf4009f3b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.500208 Sep 28 08:31:28.589553 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:28.602571 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-8d724032-f9b5-4297-885e-5b59b5c60db5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:28.607863 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:28.638051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-8d724032-f9b5-4297-885e-5b59b5c60db5 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039734 Sep 28 08:31:28.639096 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 08:31:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:31:31.375750 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-314cdf80-698f-4842-a80d-3ddaf4009f3b admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:31.376789 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-314cdf80-698f-4842-a80d-3ddaf4009f3b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003776 Sep 28 08:31:31.381135 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:31 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:31.856049 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-10992bd3-5cff-471c-aa6f-97fe7f9a176a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "id": "4", "disk": 80, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:31.877319 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-10992bd3-5cff-471c-aa6f-97fe7f9a176a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.488773 Sep 28 08:31:31.885130 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:31:31.889802 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-df4adc3d-79bf-4331-b0f0-5a2aa800195f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:31.914888 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-df4adc3d-79bf-4331-b0f0-5a2aa800195f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027998 Sep 28 08:31:31.915514 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 08:31:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:34.616007 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-10992bd3-5cff-471c-aa6f-97fe7f9a176a admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:34.618711 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-10992bd3-5cff-471c-aa6f-97fe7f9a176a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003134 Sep 28 08:31:34.620150 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:35.215930 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-055eb5cd-3849-4c67-9312-39b5de31fd9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:35.225757 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:35.239084 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-055eb5cd-3849-4c67-9312-39b5de31fd9f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.612734 Sep 28 08:31:35.239970 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Sep 28 08:31:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 08:31:35.251935 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-5c055385-39d9-4208-b847-537d287bd22e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:31:35.286645 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-5c055385-39d9-4208-b847-537d287bd22e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038364 Sep 28 08:31:35.287421 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Sep 28 08:31:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:31:52.169846 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-055eb5cd-3849-4c67-9312-39b5de31fd9f admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:52.170785 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-055eb5cd-3849-4c67-9312-39b5de31fd9f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 28 08:31:52.171191 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:52.182448 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:31:52.600666 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-df1a07f5-9abf-41be-b045-1c37b88234d8 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:52.619606 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-df1a07f5-9abf-41be-b045-1c37b88234d8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442326 Sep 28 08:31:52.620164 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 08:31:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:31:53.952604 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-055eb5cd-3849-4c67-9312-39b5de31fd9f admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:53.953649 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-055eb5cd-3849-4c67-9312-39b5de31fd9f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 28 08:31:53.954048 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:31:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:54.525301 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-cb0643d8-f234-4997-9d0b-e920b43ed3c8 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:54.530729 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.wsgi [None req-cb0643d8-f234-4997-9d0b-e920b43ed3c8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-cb0643d8-f234-4997-9d0b-e920b43ed3c8 admin admin] Request method failure captured: Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Accept: application/json Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Accept-Encoding: gzip, deflate Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Connection: keep-alive Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Content-Length: 0 Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Host: 10.222.0.52 Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Openstack-Api-Version: compute 2.92 Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Openstack-System-Scope: None Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: User-Agent: python-novaclient Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Auth-Token: gAAAAABjNAZ5h-TTVfMIGBn0T4N9LfoDEIGb1PQJCnPaEq7O1KTV6tFqc37_vIoLNmzagkXfboh4g5wfiXoFOydKhog8tSJtUXtxtYc9XrheneNKllsHdIAm4ctqhllkBKmR_SqfKUK303uKj6tUMgoYBX1it_6ECT7mioMteY9HI6ujJyKuwLA Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Domain-Id: None Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Domain-Name: None Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Identity-Status: Confirmed Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Is-Admin-Project: True Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Domain-Id: default Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Domain-Name: Default Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Name: admin Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Role: member,reader,admin Sep 28 08:31:54.534316 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Roles: member,reader,admin Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c189a0d1d6b0443ba4af2cd3c46f5c43", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant: admin Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant-Name: admin Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User: admin Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Domain-Id: default Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Domain-Name: Default Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Id: 3300b0df5e5741c8b0d940d0202bb604 Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Name: admin Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: method: > Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: exception: Flavor 42 could not be found. Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: action_args: {'id': '42'} Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:31:54.536039 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:54.536930 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.538051 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-cb0643d8-f234-4997-9d0b-e920b43ed3c8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:31:54.539107 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-cb0643d8-f234-4997-9d0b-e920b43ed3c8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.428008 Sep 28 08:31:54.539107 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 08:31:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 08:31:54.546456 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-ae4aa6d0-b58c-490b-8f4d-1a8db4ec2a6e admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:54.569760 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-ae4aa6d0-b58c-490b-8f4d-1a8db4ec2a6e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026877 Sep 28 08:31:54.570342 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 08:31:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:31:54.583147 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-d435e3e6-8c77-4b45-92d2-7cb534622d3b admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:54.605632 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-d435e3e6-8c77-4b45-92d2-7cb534622d3b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028463 Sep 28 08:31:54.606197 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 08:31:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:31:54.615819 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-20dbe6d9-2cfc-4987-9f42-d6eb90d508cb admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:54.623055 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.wsgi [None req-20dbe6d9-2cfc-4987-9f42-d6eb90d508cb admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-20dbe6d9-2cfc-4987-9f42-d6eb90d508cb admin admin] Request method failure captured: Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Accept: application/json Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Accept-Encoding: gzip, deflate Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Connection: keep-alive Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Content-Length: 0 Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Host: 10.222.0.52 Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Openstack-Api-Version: compute 2.92 Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Openstack-System-Scope: None Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: User-Agent: python-novaclient Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Auth-Token: gAAAAABjNAZ5h-TTVfMIGBn0T4N9LfoDEIGb1PQJCnPaEq7O1KTV6tFqc37_vIoLNmzagkXfboh4g5wfiXoFOydKhog8tSJtUXtxtYc9XrheneNKllsHdIAm4ctqhllkBKmR_SqfKUK303uKj6tUMgoYBX1it_6ECT7mioMteY9HI6ujJyKuwLA Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Domain-Id: None Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Domain-Name: None Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Identity-Status: Confirmed Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Is-Admin-Project: True Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Domain-Id: default Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Domain-Name: Default Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Name: admin Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Role: member,reader,admin Sep 28 08:31:54.626431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Roles: member,reader,admin Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c189a0d1d6b0443ba4af2cd3c46f5c43", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant: admin Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant-Name: admin Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User: admin Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Domain-Id: default Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Domain-Name: Default Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Id: 3300b0df5e5741c8b0d940d0202bb604 Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Name: admin Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: method: > Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: exception: Flavor 42 could not be found. Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: action_args: {'id': '42'} Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:31:54.628610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:54.630078 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:54.631867 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-20dbe6d9-2cfc-4987-9f42-d6eb90d508cb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:31:54.633257 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-20dbe6d9-2cfc-4987-9f42-d6eb90d508cb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015786 Sep 28 08:31:54.633257 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 08:31:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 08:31:55.931474 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-d435e3e6-8c77-4b45-92d2-7cb534622d3b admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:55.932499 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-d435e3e6-8c77-4b45-92d2-7cb534622d3b admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 Sep 28 08:31:55.932900 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:31:56.502277 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-a1dc11b5-c87a-4192-967f-95059519ef5e admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:56.507645 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.wsgi [None req-a1dc11b5-c87a-4192-967f-95059519ef5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-a1dc11b5-c87a-4192-967f-95059519ef5e admin admin] Request method failure captured: Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Accept: application/json Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Accept-Encoding: gzip, deflate Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Connection: keep-alive Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Content-Length: 0 Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Host: 10.222.0.52 Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Openstack-Api-Version: compute 2.92 Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Openstack-System-Scope: None Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: User-Agent: python-novaclient Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Auth-Token: gAAAAABjNAZ7PM4eJaNGoFiXQLiGHmpp7-LyRVwSGiQQCUIZzi99tqcyHiijeOEu5H4mNQAcQCRofmP02LUvtVo0AwRV8aqpXLTsj6EsC2DDvWiszDaHYVkNMHb21uOoKOOrBOqmWnVOVCTDPpm-MhajrZVPMyw_QbIoDEXSgKYJAonCOKjOTGY Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Domain-Id: None Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Domain-Name: None Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Identity-Status: Confirmed Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Is-Admin-Project: True Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Domain-Id: default Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Domain-Name: Default Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Name: admin Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Role: member,reader,admin Sep 28 08:31:56.509231 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Roles: member,reader,admin Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c189a0d1d6b0443ba4af2cd3c46f5c43", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant: admin Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant-Name: admin Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User: admin Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Domain-Id: default Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Domain-Name: Default Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Id: 3300b0df5e5741c8b0d940d0202bb604 Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Name: admin Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: method: > Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: exception: Flavor 84 could not be found. Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: action_args: {'id': '84'} Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:31:56.510859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:56.512254 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.514713 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-a1dc11b5-c87a-4192-967f-95059519ef5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:31:56.517210 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-a1dc11b5-c87a-4192-967f-95059519ef5e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.438718 Sep 28 08:31:56.517210 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 08:31:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 08:31:56.522753 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02cec388-f29b-402b-ab79-e640c93d659f admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:56.539098 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02cec388-f29b-402b-ab79-e640c93d659f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020067 Sep 28 08:31:56.539670 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 08:31:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:31:56.550273 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-24151520-6132-4bc3-8d9a-aa67b645285a admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:56.566675 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-24151520-6132-4bc3-8d9a-aa67b645285a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020009 Sep 28 08:31:56.567250 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 08:31:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:31:56.577216 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-b5556280-c524-4d25-9f30-6e6150ce4ec5 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:56.582326 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.wsgi [None req-b5556280-c524-4d25-9f30-6e6150ce4ec5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-b5556280-c524-4d25-9f30-6e6150ce4ec5 admin admin] Request method failure captured: Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Accept: application/json Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Accept-Encoding: gzip, deflate Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Connection: keep-alive Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Content-Length: 0 Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Host: 10.222.0.52 Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Openstack-Api-Version: compute 2.92 Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Openstack-System-Scope: None Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: User-Agent: python-novaclient Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Auth-Token: gAAAAABjNAZ7PM4eJaNGoFiXQLiGHmpp7-LyRVwSGiQQCUIZzi99tqcyHiijeOEu5H4mNQAcQCRofmP02LUvtVo0AwRV8aqpXLTsj6EsC2DDvWiszDaHYVkNMHb21uOoKOOrBOqmWnVOVCTDPpm-MhajrZVPMyw_QbIoDEXSgKYJAonCOKjOTGY Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Domain-Id: None Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Domain-Name: None Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Identity-Status: Confirmed Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Is-Admin-Project: True Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Domain-Id: default Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Domain-Name: Default Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Name: admin Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Role: member,reader,admin Sep 28 08:31:56.583838 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Roles: member,reader,admin Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c189a0d1d6b0443ba4af2cd3c46f5c43", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant: admin Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant-Name: admin Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User: admin Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Domain-Id: default Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Domain-Name: Default Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Id: 3300b0df5e5741c8b0d940d0202bb604 Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Name: admin Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: method: > Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: exception: Flavor 84 could not be found. Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: action_args: {'id': '84'} Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:31:56.585495 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:56.586498 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:56.588321 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-b5556280-c524-4d25-9f30-6e6150ce4ec5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:31:56.589361 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-b5556280-c524-4d25-9f30-6e6150ce4ec5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011716 Sep 28 08:31:56.589361 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Sep 28 08:31:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 08:31:57.876126 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-24151520-6132-4bc3-8d9a-aa67b645285a admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:57.877584 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-24151520-6132-4bc3-8d9a-aa67b645285a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 Sep 28 08:31:57.878248 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:31:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:31:58.451849 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-7a78496f-22c9-47b0-876b-d652b4a79478 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:58.458073 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.wsgi [None req-7a78496f-22c9-47b0-876b-d652b4a79478 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-7a78496f-22c9-47b0-876b-d652b4a79478 admin admin] Request method failure captured: Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Accept: application/json Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Accept-Encoding: gzip, deflate Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Connection: keep-alive Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Content-Length: 0 Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Host: 10.222.0.52 Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Openstack-Api-Version: compute 2.92 Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Openstack-System-Scope: None Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: User-Agent: python-novaclient Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Auth-Token: gAAAAABjNAZ9XE_LmgW0U1Q8im9WLNJ6mXDxgxrsh7M0SKYgQryukeps1rRY0LqHkXt_b68kzjIllsNY8JxqwKEb7rQpGmw_SnPiSlFYkFOqyqajbgjxtFFsHM-V9pWeY0djiLTdWmsiDAnUA3W7wZ_PBIqGjv6AGr5GA4JVaKfJX4mLTWAPIdQ Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Domain-Id: None Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Domain-Name: None Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Identity-Status: Confirmed Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Is-Admin-Project: True Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Domain-Id: default Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Domain-Name: Default Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Project-Name: admin Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Role: member,reader,admin Sep 28 08:31:58.459619 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Roles: member,reader,admin Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c189a0d1d6b0443ba4af2cd3c46f5c43", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant: admin Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-Tenant-Name: admin Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User: admin Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Domain-Id: default Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Domain-Name: Default Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Id: 3300b0df5e5741c8b0d940d0202bb604 Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: X-User-Name: admin Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: method: > Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: exception: Flavor 451 could not be found. Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: action_args: {'id': '451'} Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:31:58.461041 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:58.461881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.463700 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-7a78496f-22c9-47b0-876b-d652b4a79478 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:31:58.464931 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-7a78496f-22c9-47b0-876b-d652b4a79478 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.440550 Sep 28 08:31:58.464931 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 08:31:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 28 08:31:58.471888 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-cf8a0ac6-2093-4a20-9820-b15f66909bcf admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:58.487610 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-cf8a0ac6-2093-4a20-9820-b15f66909bcf admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019401 Sep 28 08:31:58.488199 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 08:31:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:31:58.503907 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:58.532427 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.034377 Sep 28 08:31:58.533735 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Sep 28 08:31:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:31:58.544326 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-d0407502-c4f9-417b-bc55-a6a966e7c6e1 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:58.550336 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.wsgi [None req-d0407502-c4f9-417b-bc55-a6a966e7c6e1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-d0407502-c4f9-417b-bc55-a6a966e7c6e1 admin admin] Request method failure captured: Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Accept: application/json Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Accept-Encoding: gzip, deflate Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Connection: keep-alive Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Content-Length: 0 Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Host: 10.222.0.52 Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Openstack-Api-Version: compute 2.92 Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Openstack-System-Scope: None Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: User-Agent: python-novaclient Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Auth-Token: gAAAAABjNAZ9XE_LmgW0U1Q8im9WLNJ6mXDxgxrsh7M0SKYgQryukeps1rRY0LqHkXt_b68kzjIllsNY8JxqwKEb7rQpGmw_SnPiSlFYkFOqyqajbgjxtFFsHM-V9pWeY0djiLTdWmsiDAnUA3W7wZ_PBIqGjv6AGr5GA4JVaKfJX4mLTWAPIdQ Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Domain-Id: None Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Domain-Name: None Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Identity-Status: Confirmed Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Is-Admin-Project: True Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Openstack-Nova-Api-Version: 2.92 Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Domain-Id: default Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Domain-Name: Default Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Project-Name: admin Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Role: member,reader,admin Sep 28 08:31:58.551999 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Roles: member,reader,admin Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c189a0d1d6b0443ba4af2cd3c46f5c43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c189a0d1d6b0443ba4af2cd3c46f5c43", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant: admin Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant-Id: c189a0d1d6b0443ba4af2cd3c46f5c43 Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-Tenant-Name: admin Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User: admin Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Domain-Id: default Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Domain-Name: Default Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Id: 3300b0df5e5741c8b0d940d0202bb604 Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: X-User-Name: admin Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: method: > Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: exception: Flavor 451 could not be found. Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: action_args: {'id': '451'} Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:31:58.554469 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:58.556804 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: ERROR nova.api.openstack.wsgi Sep 28 08:31:58.559176 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-d0407502-c4f9-417b-bc55-a6a966e7c6e1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:31:58.561354 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-d0407502-c4f9-417b-bc55-a6a966e7c6e1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013272 Sep 28 08:31:58.561354 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 08:31:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 28 08:31:59.852382 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:31:59.853934 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Sep 28 08:31:59.854333 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:31:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:32:00.416185 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-116cd69e-e16e-4f1f-8503-f57606805779 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:32:00.436965 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-116cd69e-e16e-4f1f-8503-f57606805779 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.442594 Sep 28 08:32:00.437570 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 08:31:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:32:01.708383 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:32:01.709623 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 28 08:32:01.710131 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:32:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:32:02.400604 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-0287d2a5-d620-4e22-be13-8871aaaa323f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:32:02.420001 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-0287d2a5-d620-4e22-be13-8871aaaa323f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.567562 Sep 28 08:32:02.420559 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 08:32:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:32:03.690125 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:32:03.691399 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001824 Sep 28 08:32:03.691886 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:32:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:32:04.240157 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-95e4383e-4995-4c6e-9ca5-1c32a8dc032e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:32:04.260049 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-95e4383e-4995-4c6e-9ca5-1c32a8dc032e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.431503 Sep 28 08:32:04.260592 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 08:32:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:32:05.502359 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:32:05.503528 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Sep 28 08:32:05.504013 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:32:06.034053 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-d9a74a2c-0343-4481-8183-e10f6fb41628 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:32:06.052670 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-d9a74a2c-0343-4481-8183-e10f6fb41628 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.408168 Sep 28 08:32:06.053241 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Sep 28 08:32:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:32:07.319805 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:32:07.320842 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 28 08:32:07.321295 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:32:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:32:07.849863 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-e3d18dc8-1035-4a7d-a40e-6f8774c9a69f admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:32:07.870704 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-e3d18dc8-1035-4a7d-a40e-6f8774c9a69f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.410852 Sep 28 08:32:07.871252 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Sep 28 08:32:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:33:05.345437 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:33:05.346334 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-02673af4-d87d-48af-91a0-506a0b51e592 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 28 08:33:05.346769 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Sep 28 08:33:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:33:05.357360 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:05.752758 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-26333d55-cc62-4641-a22b-27c6b95002f8 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:33:05.773362 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-26333d55-cc62-4641-a22b-27c6b95002f8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.420449 Sep 28 08:33:05.773896 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Sep 28 08:33:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:33:05.795061 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_api:SELECT=14 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:33:05.798870 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-9b94c6e1-e0db-457b-94a9-964c8dd7a715 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:33:05.807029 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-9b94c6e1-e0db-457b-94a9-964c8dd7a715 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013356 Sep 28 08:33:05.807558 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Sep 28 08:33:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:33:05.819267 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-7980f068-7a9b-468f-8a19-55582cfce604 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:33:05.826581 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-7980f068-7a9b-468f-8a19-55582cfce604 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010982 Sep 28 08:33:05.827108 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Sep 28 08:33:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:33:05.838330 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:33:05.845525 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010683 Sep 28 08:33:05.846049 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Sep 28 08:33:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:33:05.858264 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-0be2b862-1ee2-46e6-a65e-4cc83a56021f admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:33:05.865459 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-0be2b862-1ee2-46e6-a65e-4cc83a56021f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010782 Sep 28 08:33:05.865974 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Sep 28 08:33:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:35:59.566422 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:35:59.567492 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 28 08:35:59.567881 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:35:59.710816 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_api:SELECT=6 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:35:59.871994 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:35:59.877381 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:35:59.877901 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:35:59.878485 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:35:59.879332 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:35:59.879780 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:35:59.880201 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:35:59.913323 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-2d2fb527-d9b5-408f-abbe-fd84e949c7ab admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.203601 Sep 28 08:35:59.913935 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 08:35:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:36:01.000866 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:36:01.001908 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 28 08:36:01.002286 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:36:01.198374 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:36:01.201779 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:36:01.202262 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:36:01.202693 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:36:01.203410 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:36:01.203859 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:36:01.204278 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:36:01.223777 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-812204e5-1017-4f55-aa7d-a601cb740e9d admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077595 Sep 28 08:36:01.224260 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 08:36:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:36:12.739102 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:36:12.740105 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 28 08:36:12.740522 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:36:12.903324 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_cell0:SELECT=4 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:36:12.907868 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_cell1:SELECT=4 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:36:12.907868 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG dbcounter [-] [105692] Writing DB stats nova_api:SELECT=8 {{(pid=105692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:36:12.956308 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:36:12.959755 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:36:12.960230 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:36:12.960661 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:36:12.961403 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:36:12.961857 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:36:12.962272 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:36:12.987431 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-cb301983-09bb-4f3f-83cd-388612ab8eae admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.088898 Sep 28 08:36:12.987976 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 08:36:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:36:14.089531 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG nova.api.openstack.wsgi [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] Calling method '>' {{(pid=105691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:36:14.090573 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: INFO nova.api.openstack.requestlog [None req-1fedd758-c5e9-4a1f-bf34-76af47d47689 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 28 08:36:14.090969 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: [pid: 105691|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Sep 28 08:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:36:14.284757 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG nova.api.openstack.wsgi [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] Calling method '>' {{(pid=105692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:36:14.288395 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:36:14.289474 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:36:14.289826 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:36:14.290542 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:36:14.290995 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:36:14.291414 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: DEBUG oslo_concurrency.lockutils [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:36:14.316496 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: INFO nova.api.openstack.requestlog [None req-66b01ca0-f504-444f-8118-5d110c0db495 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.082860 Sep 28 08:36:14.316970 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: [pid: 105692|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Sep 28 08:36:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:37:11.321070 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: Wed Sep 28 08:37:11 2022 - graceful shutdown triggered... Sep 28 08:37:11.320812 dv-cinder-844563-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 28 08:37:11.322050 dv-cinder-844563-8-iscsi devstack@n-api.service[105692]: Gracefully killing worker 2 (pid: 105692)... Sep 28 08:37:11.322708 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: Gracefully killing worker 1 (pid: 105691)... Sep 28 08:37:11.450289 dv-cinder-844563-8-iscsi devstack@n-api.service[105691]: DEBUG dbcounter [-] [105691] Writing DB stats nova_api:SELECT=4 {{(pid=105691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:12.321240 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: worker 1 buried after 1 seconds Sep 28 08:37:12.321937 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: worker 2 buried after 1 seconds Sep 28 08:37:12.321937 dv-cinder-844563-8-iscsi devstack@n-api.service[105690]: goodbye to uWSGI. Sep 28 08:37:12.322921 dv-cinder-844563-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 28 08:37:12.323799 dv-cinder-844563-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 28 08:37:12.326830 dv-cinder-844563-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 28 08:37:12.336176 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 28 08:37:12 2022] *** Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: nodename: dv-cinder-844563-8-iscsi Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: machine: x86_64 Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: clock source: unix Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: pcre jit disabled Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: detected number of CPU cores: 4 Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: current working directory: / Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: detected binary path: /usr/bin/uwsgi-core Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: your processes number limit is 47680 Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: your memory page size is 4096 bytes Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: detected max file descriptor number: 2048 Sep 28 08:37:12.338240 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: lock engine: pthread robust mutexes Sep 28 08:37:12.339140 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: thunder lock: enabled Sep 28 08:37:12.339140 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 28 08:37:12.339140 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 28 08:37:12.382453 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: Python main interpreter initialized at 0x556cd1d039c0 Sep 28 08:37:12.382453 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: python threads support enabled Sep 28 08:37:12.382453 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: your server socket listen backlog is limited to 100 connections Sep 28 08:37:12.382453 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: your mercy for graceful operations on workers is 90 seconds Sep 28 08:37:12.382862 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: mapped 403077 bytes (393 KB) for 2 cores Sep 28 08:37:12.382937 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: *** Operational MODE: preforking *** Sep 28 08:37:12.383211 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: *** uWSGI is running in multiple interpreter mode *** Sep 28 08:37:12.383211 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: spawned uWSGI master process (pid: 127091) Sep 28 08:37:12.383421 dv-cinder-844563-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 28 08:37:12.386804 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: spawned uWSGI worker 1 (pid: 127110, cores: 1) Sep 28 08:37:12.386804 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: spawned uWSGI worker 2 (pid: 127111, cores: 1) Sep 28 08:37:12.386804 dv-cinder-844563-8-iscsi devstack@n-api.service[127091]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 28 08:37:13.053782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 08:37:13.062737 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 28 08:37:14.212854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:37:14.212854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: from cryptography.utils import int_from_bytes Sep 28 08:37:14.213511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:37:14.213511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: from cryptography.utils import int_from_bytes Sep 28 08:37:14.233934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:37:14.233934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: from cryptography.utils import int_from_bytes Sep 28 08:37:14.234493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 28 08:37:14.234493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: from cryptography.utils import int_from_bytes Sep 28 08:37:16.668455 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 08:37:16.669395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 08:37:16.669395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 08:37:16.669583 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 08:37:16.669804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 08:37:16.670204 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.670541 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.670868 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.671261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.671602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.671921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.672256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.672583 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.672919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.673218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.673548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.674055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-8-iscsi {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.674387 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.674710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.675031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.675357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.675675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.676010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.676334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.676862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.678294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.678294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.678509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.678745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.679027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.679349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.679679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.679997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.680332 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.680651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.681147 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-8-iscsi {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.681504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.681863 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.682192 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.682617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.682934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.683249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.683588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.683910 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.684235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.684561 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.684890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.685243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.685574 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.685885 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.686195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.686513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.687383 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.687696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.688011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.688267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.688580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.688912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.689269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.689602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.689854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.690113 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.690435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.690760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.691078 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.691393 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.691704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.692372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.692372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.692637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.692928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.693263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.693608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.694078 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.694238 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.694769 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.695104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.695563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.695786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.696112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.696466 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.696793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.697165 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.697462 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.697794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.698104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.698422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.698738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.699063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.699404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.699714 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.699971 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.700282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.700595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.700920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.701259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.701576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.701890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.702197 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.703070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.703389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.703699 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.704018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.704335 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.704472 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 28 08:37:16.704908 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 28 08:37:16.704992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.704992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.705161 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 28 08:37:16.705267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.705533 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 28 08:37:16.705798 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 28 08:37:16.706118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.706253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.706433 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.706652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.706765 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.706983 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.707092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.707310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.707398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708123 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708542 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.708897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.709132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.709222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.709298 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.709498 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.709624 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.709853 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.709980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-8-iscsi {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.710164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.710309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.710488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.710626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.710802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.710942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.711117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.711265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.711443 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.711575 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.711750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.711903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.712064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.712230 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.712387 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.712700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.712798 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.713010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.713135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.713346 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.713653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.713958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.714267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.714365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.714574 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.714674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.714882 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.715188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.715305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.715510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.715601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.715839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.715945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.716161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.716251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.716471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.716561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.716781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.716886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.717122 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.717238 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.717473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.717575 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-8-iscsi {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.717811 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.717924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.718199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.718318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.718518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.718608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.718854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.718953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.719191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.719294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.719514 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.719618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.719831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.719922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.720153 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.720245 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.720475 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.720578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.720790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.720894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.721113 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.721219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.721440 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.721545 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.721763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.721851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.722076 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.722175 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.722390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.722481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.722701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.722800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.723021 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.723120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.723327 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.723417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.723637 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.723727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.723891 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.723989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.724204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.724302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.724528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.724618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.724852 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.724954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.725200 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.725311 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.725459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.725592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.725714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.725918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.726038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.726250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.726363 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.726582 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.726671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.726903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.726994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.727221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.727319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.727538 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.727645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.727864 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.727954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.728175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.728265 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.728485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.728592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.728795 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.728886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.729162 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.729268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.729452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.729554 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.729771 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.729867 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.730096 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.730194 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.730394 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.730508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.730713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.730812 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.731572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.731666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.731666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.731812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.731892 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.732080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.732158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.732235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.732314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.732385 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.732589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.732670 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.732909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.732994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.733417 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.733600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.733749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.733889 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.734029 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.734181 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.734336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.734484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.734484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.734777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.734917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.736308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.736477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.736584 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.736671 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.736755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.736854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.736951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.737041 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.737195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.737279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.737363 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.737450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.737542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.737631 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.737713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.737793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.737873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.737953 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.738045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.738127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.738208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.738294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.738383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.738473 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.738621 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.738754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.738860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.739063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.739161 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.739370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.739460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.739682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.739782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.739991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.740082 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.740298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.740389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.740617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.740707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.740930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.741020 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.741285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.741427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.741599 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.741698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.741921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.742035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.742246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.742552 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.742651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.742744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.742876 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.742977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.743184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.743288 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.743506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.743612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.743816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.743913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.744124 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.744230 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.744447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.744545 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.744760 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.744865 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.745074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.745228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.745419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.745522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.745727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.745822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.746042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.746133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.746351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.746464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.746663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.746762 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.746969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.747065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.747278 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.747378 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.747584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.747682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.747891 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.748030 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.748196 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.748300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.748499 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.748596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.748806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.748961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.749118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.749983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.750084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.750178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.750269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.750351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.750564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.750664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.750872 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.750972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.751178 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.751275 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.751503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 28 08:37:16.751595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.751852 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.751954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.752189 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.752280 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.752510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.752600 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.752841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.752932 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.753181 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.753295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.753506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.753621 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.753827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.753939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.754143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.754248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.754460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.754553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.754779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.754881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.755106 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.755205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.755421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.755519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.755734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.755824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.756053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.756161 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.756379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.756506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.756698 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.756803 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.757020 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.757180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.757356 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.757447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.757677 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.757774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.757995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.758146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.758319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.758415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.758653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.758752 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.758988 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.759137 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.759294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.759386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.759612 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.759704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.759927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.760031 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.760240 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.760332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.760555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.760660 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.760869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.760960 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.761216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.761349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.761533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.761665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.761857 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.761981 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.762168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.762260 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.762498 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.762606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.762814 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.762903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.763135 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.763225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.763446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.763547 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.763768 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.763893 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.764086 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.764195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.764398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.764498 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.764714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.764855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.765632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.765776 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.765956 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.766043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.766266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.766400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.766590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.766691 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.766908 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.767000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.767222 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.767321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.767535 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.767632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.767850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.767942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.768165 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.768262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.768479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.768567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.768792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.768891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.769121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.769269 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.769518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.769634 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.769726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.769807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.770037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.770129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.770345 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.770447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.770663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.770754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.770992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.771083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.771302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.771399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.771628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.771726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.771947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.772047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.772256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.772359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.772567 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.772665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.772881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.772972 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.773220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.773349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.773628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.773840 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.773937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.774151 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.774266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.774482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.774584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.774797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.774896 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.775105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.775201 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.775427 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.775524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.775739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.775897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.776050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.776150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.776370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.776539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.776684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.776790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.776997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.777121 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.777338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.777429 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.777656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.777760 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.777970 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.778069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.778290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.778404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.778608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.778733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.778950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.779048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.779286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.779386 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.779598 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.779697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.779927 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.780018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.780277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.780375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.780625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.780754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.780937 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.781025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.781275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.781368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.781601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.781699 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.781917 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.782191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.782288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.782527 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.782629 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.782836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.782934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.783148 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.783246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.783459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.783563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.783768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.783871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.784077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.784167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.784405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.784498 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.784717 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.784808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.785025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.785195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.785360 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.785463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.785666 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.785764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.785977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.786076 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.786292 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.786383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.786609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.786717 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.786919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.787010 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.787227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.787327 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.787792 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.787902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.788104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.788195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.788415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.788514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.788721 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.788821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.789029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.789150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.789376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.789468 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.789685 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.789785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.790002 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.790100 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.790310 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.790407 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.790635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.790737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.790946 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.791038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.791253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.791344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.791563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.791661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.791870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.791969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.792192 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.792283 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.792512 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.792614 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.792852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.792949 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.793214 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.793307 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.793541 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.793673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.793860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.793950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.794170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.794268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.794489 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.794579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.794796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.794892 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.795105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.795204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.795413 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.795514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.795724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.795820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.796053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.796200 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.796367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.796466 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.796688 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.796803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.797000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.797164 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.797342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.797445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.797657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.797758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.797963 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.798055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.798277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.798377 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.798584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.798681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.798907 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.798999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.799221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.799319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.799529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.799628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.799838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.799937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.800152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.800244 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.800463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.800562 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.800771 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.800863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.801119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.801218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.801415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.801523 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.801724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.801815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.802031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.802119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.802338 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.802441 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.802646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.802738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.802958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.803049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.803268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.803380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.803575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.803673 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.803885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.803983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.804196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.804295 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.804503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.804593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.804812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.804911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.805146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.805253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.805458 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.805558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.805767 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.805865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.806079 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.806216 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.806390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.806488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.806702 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.806800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.807022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.807113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.807333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.807427 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.807641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.807749 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.807950 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.808041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.808256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.808352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.808569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.808709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.808880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.808972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.809212 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.809363 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.809525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.809630 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.809836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.809937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.810145 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.810237 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.810462 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.810563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.810778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.810875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.811089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.811187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.811401 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.811502 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.812242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.812359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.812582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.812680 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.812893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.812984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.813237 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.813331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.813557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.813657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.813873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.813973 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.814204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.814295 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.814518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.814654 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.814834 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.814932 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.815157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.815468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.815776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.815867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.816092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.816190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.816412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.816511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.816721 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.816813 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.817037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.817336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.817463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.817682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.817807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.817996 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.818113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.818321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.818439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.818651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.818776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.818983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.819156 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.819277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.819388 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.819598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.819726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.819917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.820041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.820229 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.820478 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.820596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.820807 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.820927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.821144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.821279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.821468 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.821563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.821794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.821884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.822106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.822205 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.822421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.822523 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.822733 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.822824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.823048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.823137 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.823355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.823453 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.823665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.823763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.823971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.824069 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.824281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.824373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.824598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.824684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.824906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.825003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.825237 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.825341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.825546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.825635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.825857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.826024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.826179 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.826317 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.826608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.826934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.827076 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.827247 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.827976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.828143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.828259 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.828468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.828618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.828797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.828942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.829139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.829292 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.829456 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.829631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.829887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.829978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.830209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.830307 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.830530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.830667 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.830851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.830945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.831165 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.831291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.831476 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.831578 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.831792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.831891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.832109 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.832208 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.832493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.832585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.832806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.832903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.833139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.833245 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.833458 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.833556 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.833775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.833883 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.834088 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.834179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.834398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.834505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.834714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.834843 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.835022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.835112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.835347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.835531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.835663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.835848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.835972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.836164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.836282 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.836493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.836592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.836822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.836922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.837185 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.837302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.837502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.837600 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.837817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.837912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.838132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.838223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.838440 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.838537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.838751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.838841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.839059 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.839151 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.839374 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.839463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.839687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.839786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.839995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.840094 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.840323 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.840422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.840641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.840745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.840951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.841042 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.841353 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.841441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.841671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.841779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.841980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.842078 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.842291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.842388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.842605 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.842744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.842957 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.843055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.843289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.843388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.843604 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.843696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.843918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.844015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.844227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.844318 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.844541 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.844639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.844851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.844995 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.845189 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.845285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.845503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.845602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.845815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.845905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.846122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.846211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.846431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.846522 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.846738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.846828 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.847066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.847229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.847380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.847478 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.847692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.847783 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.848006 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.848111 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.848316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.848415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.848636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.848725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.848966 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.849068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.849309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.849400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.849622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.849723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.849937 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.850038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.850249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.850340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.850588 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.850694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.850905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.850998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.851222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.851312 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.851539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.851664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.851862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.851968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.852178 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.852269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.852499 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.852600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.852809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.852901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.853139 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.853233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.853471 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.853563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.853790 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.853895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.854105 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.854204 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.854420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.854518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.854736 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.854828 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.855054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.855163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.855368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.855467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.855681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.855774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.855996 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.856095 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.856308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.856407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.856616 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.856713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.856936 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.857035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.857271 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.857369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.857592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.857694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.857903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.858003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.858222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.858311 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.858563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.858687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.858876 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.858979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.859192 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.859320 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.859502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.859627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.859814 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.859916 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.860149 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.860247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.860465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.860561 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.860778 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.860912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.861113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.861212 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.861438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.861756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.862077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.862242 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.862398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.862570 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.862719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.862889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.863038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.863337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.863429 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.863655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.863752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.863974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.864065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.864289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.864379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.864608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.864697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.864932 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.865192 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.865299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.865530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.865629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.865850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.865951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.866171 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.866315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.866490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.866638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.866810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.866957 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.867136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.867309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.867456 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.867591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.867757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.867903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.868073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.868222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.868390 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.868554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.868726 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.868866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.869053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.869201 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.869409 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.869501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.869753 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.869896 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.870078 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.870178 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.870399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.870491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.870719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.870855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.871038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.871175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.871399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.871503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.871721 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.871906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.872036 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.872222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.872340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.872539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.872650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.872869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.872967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.873221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.873372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.873555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.873656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.873868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.873959 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.874703 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.874813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.875022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.875113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.875336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.875428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.875655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.875757 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.875974 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.876067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.876295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.876391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.876608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.876708 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.876938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.877039 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.877280 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.877428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.877603 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.877705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.877922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.878015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.878345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.878457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.878680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.878773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.878999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.879186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.879330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.879527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.879665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.879861 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.879960 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.880187 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.880286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.880511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.880610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.880845 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.880945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.881182 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.881313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.881497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.881590 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.881814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.881906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.882129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.882219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.882444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.882546 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.882763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.882890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.883107 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.883240 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.883448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.883541 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.883871 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.883978 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.884277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.884397 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.884689 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.884901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.885043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.885292 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.885385 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.885622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.885716 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.885957 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.886049 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.886292 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.886392 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.886620 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.886713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.886936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.887028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.887252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.887349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.887567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.887662 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.887881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.887973 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.888207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.888317 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.888525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.888626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.888838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.888930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.889176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.889286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.889497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.889597 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.890396 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.890502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.890718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.890822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.891037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.891129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.891351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.891454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.891678 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.891783 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.891989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.892079 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.892301 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.892399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.892614 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.892716 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.892929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.893026 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.893265 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.893370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.893578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.893678 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.893891 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.893985 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.894213 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.894525 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.894840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.894934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.895151 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.895242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.895481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.895579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.895794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.895893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.896124 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.896222 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.896439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.896539 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.896750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.896849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.897062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.897191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.897394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.897499 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.897850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.898057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.898148 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.898392 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.898492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.898708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.898800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.899021 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.899110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.899348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.899486 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.899664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.899768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.899981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.900071 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.900305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.900397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.900627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.900718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.900948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.901196 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.901310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.901542 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.901644 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.901871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.901963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.902211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.902318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.902537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.902630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.902852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.903100 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.903199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.903438 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.903530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.903758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.903857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.904077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.904176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.904391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.904488 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.904705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.904797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.905021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.905154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.905361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.905483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.905701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.905798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.906013 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.906114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.906327 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.906418 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.906638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.906730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.906952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.907044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.907266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.907365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.907584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.907683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.907898 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.907997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.908210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.908303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.908531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.908629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.908846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.908945 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.909211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.909305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.909535 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.909638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.909847 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.909944 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.910166 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.910263 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.910483 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.910583 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.910800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.910935 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.911115 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.911214 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.911428 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.911534 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.911749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.911846 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.912074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.912210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.912392 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.912493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.912969 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.913062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.913308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.913428 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.913628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.913748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.913958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.914059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.914299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.914392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.914624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.914717 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.914944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.915045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.915261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.915371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.915583 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.915675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.915958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.916118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.916273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.916447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.916611 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.916792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.916958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.917148 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.917327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.917484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.917664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.917811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.917976 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.918138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.918316 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.918524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.918636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.918793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.918893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.919106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.919211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.919425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.919518 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.919742 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.919838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.920052 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.920154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.920382 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.920473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.920697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.920787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.921005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.921156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.921371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.921462 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.921681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.921772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.921996 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.922227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.922327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.922581 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.922679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.922887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.923030 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.923196 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.923291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.923503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.923594 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.923811 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.923917 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.924125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.924217 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.924432 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.924523 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.924740 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.924841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.925045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.925158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.925398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.925501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.925714 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.925814 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.926021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.926121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.926333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.926469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.926652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.926745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.926965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.927065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.927275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.927368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.927591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.927690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.927900 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.927991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.928233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.928326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.928544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.928645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.928853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.928953 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.929189 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.929297 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.929510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.929602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.929821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.929914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.930131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.930231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.930441 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.930533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.930750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.930842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.931066 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.931170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.931374 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.931472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.931704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.931829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.932037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.932138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.932349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.932442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.932681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.932781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.933006 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.933122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.933357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.933450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.933678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.933771 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.933988 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.934080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.934300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.934400 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.934622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.934721 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.934937 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.935028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.935251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.935349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.935565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.935663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.935879 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.935977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.936200 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.936291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.936516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.936618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.937367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.937590 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.937691 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.937934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.938026 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.938262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.938361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.938604 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.938696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.938934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.939033 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.939247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.939337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.939561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.939652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.939872 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.939977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.940203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.940302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.940519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.940618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.940836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.940940 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.941175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.941282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.941494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.941585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.941805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.941940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.942040 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 08:37:16.942125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.942423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.942736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.943051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.943364 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.943678 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.943992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.944307 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.944619 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.944939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.945318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.945647 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.945972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.946293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.946616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.946933 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.947251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.947569 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.947885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.948209 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.948546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.948869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.949207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.949640 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.949960 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.950284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.950613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.950929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.951257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.951586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.951909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.952238 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.953113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.953525 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.953800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.954136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.954467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.954781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.955093 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.955404 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.955719 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.956043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.956358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.956666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.956973 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.957316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.957627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.957937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.958244 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.958553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.958865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.959171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.959480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.959787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.960093 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.960399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.960706 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.961018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.961351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.961663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.961976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.962287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.962589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.962925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.963262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.963663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.963912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.964230 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.964556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.964873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.965224 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.965553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.965876 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.966193 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.966535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.966852 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.967173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.967495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.967808 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.968169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.968486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.968822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.969177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.969500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.969835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.970154 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.970485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.970805 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.971124 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.971460 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.971785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.972106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.972500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.972824 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.973160 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.973485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.973864 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.974113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.974437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.975010 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.975483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.975823 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.976274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.976850 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.977224 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.977622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.978074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.978433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.978770 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.979097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.979419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.979732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 28 08:37:16.979987 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 28 08:37:17.005170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO dbcounter [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Registered counter for database nova_api Sep 28 08:37:17.026187 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_db.sqlalchemy.engines [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.032754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writer thread running {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.042820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO dbcounter [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Registered counter for database nova_api Sep 28 08:37:17.064195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_db.sqlalchemy.engines [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.070853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writer thread running {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.090550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.context [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e2a57ab-fab2-4986-9c64-da0c4216fc01(cell1) {{(pid=127110) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 08:37:17.094737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:37:17.095296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:37:17.096823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:37:17.097616 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:37:17.098071 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:37:17.100108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:37:17.102184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO dbcounter [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Registered counter for database nova_cell0 Sep 28 08:37:17.106412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO dbcounter [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Registered counter for database nova_cell1 Sep 28 08:37:17.114608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_db.sqlalchemy.engines [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.116355 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_db.sqlalchemy.engines [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.122002 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writer thread running {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.125127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writer thread running {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.129549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.context [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e2a57ab-fab2-4986-9c64-da0c4216fc01(cell1) {{(pid=127111) load_cells /opt/stack/nova/nova/context.py:464}} Sep 28 08:37:17.133614 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:37:17.134095 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:37:17.135697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:37:17.136451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:37:17.136903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:37:17.138983 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:37:17.141057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO dbcounter [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Registered counter for database nova_cell0 Sep 28 08:37:17.145246 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO dbcounter [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Registered counter for database nova_cell1 Sep 28 08:37:17.152435 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_db.sqlalchemy.engines [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.154228 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_db.sqlalchemy.engines [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.160569 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writer thread running {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.161916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writer thread running {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.276472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO dbcounter [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Registered counter for database nova_cell0 Sep 28 08:37:17.283388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_db.sqlalchemy.engines [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.288179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writer thread running {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.314458 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO dbcounter [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Registered counter for database nova_cell0 Sep 28 08:37:17.320975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_db.sqlalchemy.engines [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 28 08:37:17.325597 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writer thread running {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 28 08:37:17.612701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: WARNING keystonemiddleware.auth_token [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:37:17.620047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: WARNING keystonemiddleware.auth_token [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:37:17.654976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: WARNING keystonemiddleware.auth_token [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:37:17.663254 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: WARNING keystonemiddleware.auth_token [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:37:17.971273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: WARNING keystonemiddleware.auth_token [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:37:17.977339 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: WARNING keystonemiddleware.auth_token [None req-3f68653b-b463-4504-8edc-28082d8ce6bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:37:17.982627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556cd1d039c0 pid: 127110 (default app) Sep 28 08:37:18.012579 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: WARNING keystonemiddleware.auth_token [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 28 08:37:18.018787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: WARNING keystonemiddleware.auth_token [None req-5e74de7f-eef5-499e-b28d-b75c057b5b62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 28 08:37:18.024118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556cd1d039c0 pid: 127111 (default app) Sep 28 08:37:54.743308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:54.744823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:54.746362 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:54.747389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:54.830745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:54.832340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:54.832965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:54.833985 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:37:56.587810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f0a6e297-5ba3-447a-816c-d41fc377f7e2 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Action: 'create', calling method: .version_select at 0x7f9854c3c550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2088494718", "metadata": {"Type": "work"}}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:37:56.618014 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c061f6bf-bb6f-428a-8d90-7d980f5abd8f tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Action: 'create', calling method: .version_select at 0x7f9854c3d4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1632521758", "metadata": {"Type": "work"}}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c061f6bf-bb6f-428a-8d90-7d980f5abd8f tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Request method failure captured: Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 122 Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAfi2s2CWo5mtaM-X93lDzcW5n4TPntMqIHX7zoidajf5bwJNUgA0e-51Ob_aSLghgXtBMHERWybu7SXGZcPmm6l1ckJoFOzjYCr74t-zTBGZmip6AryVC_9nf686kDqazf6DrPxU1kHAKKdBZhaF3Njj4wGIoe21nq4eUbHw1c7kHw Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:37:56.633829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaf9ee385c3f44049510466e54c3eac5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 0c39ace862664bf5b0c8130806ae27d9 Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1632521758", "metadata": {"Type": "work"}}} Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:37:56.635341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1632521758', 'metadata': {'Type': 'work'}}}} Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise error Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi '#$%' Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:37:56.636125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 08:37:56.637500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 08:37:56.638645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 28 08:37:56.638645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.638645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c061f6bf-bb6f-428a-8d90-7d980f5abd8f tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:37:56.638645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c061f6bf-bb6f-428a-8d90-7d980f5abd8f tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.810566 Sep 28 08:37:56.638645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 08:37:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1814 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 28 08:37:56.660751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a5926bde-fb1a-4185-99db-40065480a5e1 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Action: 'create', calling method: .version_select at 0x7f9854c3ddc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2042523134", "metadata": {"Type": "work"}}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a5926bde-fb1a-4185-99db-40065480a5e1 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Request method failure captured: Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 120 Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAfi2s2CWo5mtaM-X93lDzcW5n4TPntMqIHX7zoidajf5bwJNUgA0e-51Ob_aSLghgXtBMHERWybu7SXGZcPmm6l1ckJoFOzjYCr74t-zTBGZmip6AryVC_9nf686kDqazf6DrPxU1kHAKKdBZhaF3Njj4wGIoe21nq4eUbHw1c7kHw Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:37:56.666288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaf9ee385c3f44049510466e54c3eac5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 0c39ace862664bf5b0c8130806ae27d9 Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2042523134", "metadata": {"Type": "work"}}} Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:37:56.668408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2042523134', 'metadata': {'Type': 'work'}}}} Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise error Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi '0' Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:37:56.669705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 08:37:56.671024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 08:37:56.675131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 28 08:37:56.675131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.675131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a5926bde-fb1a-4185-99db-40065480a5e1 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:37:56.675131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a5926bde-fb1a-4185-99db-40065480a5e1 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019561 Sep 28 08:37:56.675131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 08:37:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:37:56.681305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-93f74894-f4e7-4c9b-90c2-db60438a6cc3 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Action: 'create', calling method: .version_select at 0x7f9854afa1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-940279893", "metadata": {"Type": "work"}}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-93f74894-f4e7-4c9b-90c2-db60438a6cc3 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Request method failure captured: Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 118 Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAfi2s2CWo5mtaM-X93lDzcW5n4TPntMqIHX7zoidajf5bwJNUgA0e-51Ob_aSLghgXtBMHERWybu7SXGZcPmm6l1ckJoFOzjYCr74t-zTBGZmip6AryVC_9nf686kDqazf6DrPxU1kHAKKdBZhaF3Njj4wGIoe21nq4eUbHw1c7kHw Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:37:56.688334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaf9ee385c3f44049510466e54c3eac5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 0c39ace862664bf5b0c8130806ae27d9 Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-940279893", "metadata": {"Type": "work"}}} Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:37:56.689802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-940279893', 'metadata': {'Type': 'work'}}}} Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise error Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi '' Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:37:56.690568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 28 08:37:56.692143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 28 08:37:56.696897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 28 08:37:56.696897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:56.696897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-93f74894-f4e7-4c9b-90c2-db60438a6cc3 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:37:56.696897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-93f74894-f4e7-4c9b-90c2-db60438a6cc3 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014286 Sep 28 08:37:56.696897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 08:37:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:37:56.705504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-74e5ed5e-ba89-4f2e-a829-f115f38bf6d2 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Calling method '.version_select at 0x7f9854afac10>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:37:57.366802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-74e5ed5e-ba89-4f2e-a829-f115f38bf6d2 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] HTTP exception thrown: Volume tempest-invalid-2135082329 could not be found. Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-74e5ed5e-ba89-4f2e-a829-f115f38bf6d2 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Request method failure captured: Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2135082329 HTTP/1.1 Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAfi2s2CWo5mtaM-X93lDzcW5n4TPntMqIHX7zoidajf5bwJNUgA0e-51Ob_aSLghgXtBMHERWybu7SXGZcPmm6l1ckJoFOzjYCr74t-zTBGZmip6AryVC_9nf686kDqazf6DrPxU1kHAKKdBZhaF3Njj4wGIoe21nq4eUbHw1c7kHw Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:37:57.371277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaf9ee385c3f44049510466e54c3eac5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 0c39ace862664bf5b0c8130806ae27d9 Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Volume tempest-invalid-2135082329 could not be found. Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'tempest-invalid-2135082329'} Sep 28 08:37:57.372886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2135082329 could not be found. (HTTP 404) (Request-ID: req-ee3da971-c1da-442f-aea2-e7fdfde7a8f2) Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.374083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 08:37:57.375414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2135082329 could not be found. Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:37:57.376648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2135082329 could not be found. Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2135082329 could not be found. Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.378118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-74e5ed5e-ba89-4f2e-a829-f115f38bf6d2 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Returning 404 to user: Volume tempest-invalid-2135082329 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:37:57.379820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-74e5ed5e-ba89-4f2e-a829-f115f38bf6d2 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2135082329" status: 404 len: 99 microversion: 2.1 time: 0.681496 Sep 28 08:37:57.381708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 08:37:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2135082329 => generated 99 bytes in 685 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 28 08:37:57.393669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6f8d924f-8c91-4d7b-8dd7-bfd87c81b792 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006078 Sep 28 08:37:57.401051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Sep 28 08:37:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 28 08:37:57.414713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e9e72663-c95e-490d-bac5-378d465c0b3e tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007265 Sep 28 08:37:57.415653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Sep 28 08:37:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 28 08:37:57.429852 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6619ce8d-d6a2-43cc-a551-f281fd59b090 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Calling method '.version_select at 0x7f9854a7be50>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:37:57.559131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-6619ce8d-d6a2-43cc-a551-f281fd59b090 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] HTTP exception thrown: Volume 1dbe3e01-dab7-444e-bb29-d5c7625111af could not be found. Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6619ce8d-d6a2-43cc-a551-f281fd59b090 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Request method failure captured: Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/os-volumes/1dbe3e01-dab7-444e-bb29-d5c7625111af HTTP/1.1 Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAfi2s2CWo5mtaM-X93lDzcW5n4TPntMqIHX7zoidajf5bwJNUgA0e-51Ob_aSLghgXtBMHERWybu7SXGZcPmm6l1ckJoFOzjYCr74t-zTBGZmip6AryVC_9nf686kDqazf6DrPxU1kHAKKdBZhaF3Njj4wGIoe21nq4eUbHw1c7kHw Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:37:57.566554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaf9ee385c3f44049510466e54c3eac5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 0c39ace862664bf5b0c8130806ae27d9 Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Volume 1dbe3e01-dab7-444e-bb29-d5c7625111af could not be found. Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '1dbe3e01-dab7-444e-bb29-d5c7625111af'} Sep 28 08:37:57.567853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1dbe3e01-dab7-444e-bb29-d5c7625111af could not be found. (HTTP 404) (Request-ID: req-a942e254-c795-4104-a672-3d4670276332) Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.568592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 08:37:57.569684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1dbe3e01-dab7-444e-bb29-d5c7625111af could not be found. Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 08:37:57.574005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1dbe3e01-dab7-444e-bb29-d5c7625111af could not be found. Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1dbe3e01-dab7-444e-bb29-d5c7625111af could not be found. Sep 28 08:37:57.575351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.580445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6619ce8d-d6a2-43cc-a551-f281fd59b090 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Returning 404 to user: Volume 1dbe3e01-dab7-444e-bb29-d5c7625111af could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:37:57.585778 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6619ce8d-d6a2-43cc-a551-f281fd59b090 tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/1dbe3e01-dab7-444e-bb29-d5c7625111af" status: 404 len: 109 microversion: 2.1 time: 0.160741 Sep 28 08:37:57.589704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:37:57 2022] DELETE /compute/v2.1/os-volumes/1dbe3e01-dab7-444e-bb29-d5c7625111af => generated 109 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 08:37:57.614802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-42a9d196-310f-4c4d-97c9-bcbeae7af41e tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Calling method '.version_select at 0x7f9854a2e5e0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:37:57.794200 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-42a9d196-310f-4c4d-97c9-bcbeae7af41e tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] HTTP exception thrown: Volume 81ff67c3-8ce0-41fb-948e-db66120d5a4f could not be found. Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-42a9d196-310f-4c4d-97c9-bcbeae7af41e tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Request method failure captured: Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/os-volumes/81ff67c3-8ce0-41fb-948e-db66120d5a4f HTTP/1.1 Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAfi2s2CWo5mtaM-X93lDzcW5n4TPntMqIHX7zoidajf5bwJNUgA0e-51Ob_aSLghgXtBMHERWybu7SXGZcPmm6l1ckJoFOzjYCr74t-zTBGZmip6AryVC_9nf686kDqazf6DrPxU1kHAKKdBZhaF3Njj4wGIoe21nq4eUbHw1c7kHw Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:37:57.798234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/aaf9ee385c3f44049510466e54c3eac5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_aaf9ee385c3f44049510466e54c3eac5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: aaf9ee385c3f44049510466e54c3eac5 Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesNegativeTest-1984034056 Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 0c39ace862664bf5b0c8130806ae27d9 Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesNegativeTest-1984034056-project Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Volume 81ff67c3-8ce0-41fb-948e-db66120d5a4f could not be found. Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '81ff67c3-8ce0-41fb-948e-db66120d5a4f'} Sep 28 08:37:57.799851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81ff67c3-8ce0-41fb-948e-db66120d5a4f could not be found. (HTTP 404) (Request-ID: req-40765c20-5a28-4cb1-87c6-fc3aa171c33d) Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.800799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:37:57.802451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81ff67c3-8ce0-41fb-948e-db66120d5a4f could not be found. Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 08:37:57.803958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81ff67c3-8ce0-41fb-948e-db66120d5a4f could not be found. Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81ff67c3-8ce0-41fb-948e-db66120d5a4f could not be found. Sep 28 08:37:57.806369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:37:57.808298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-42a9d196-310f-4c4d-97c9-bcbeae7af41e tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] Returning 404 to user: Volume 81ff67c3-8ce0-41fb-948e-db66120d5a4f could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:37:57.810254 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-42a9d196-310f-4c4d-97c9-bcbeae7af41e tempest-VolumesNegativeTest-1984034056 tempest-VolumesNegativeTest-1984034056-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/81ff67c3-8ce0-41fb-948e-db66120d5a4f" status: 404 len: 109 microversion: 2.1 time: 0.214996 Sep 28 08:37:57.811146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 8/8] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:37:57 2022] GET /compute/v2.1/os-volumes/81ff67c3-8ce0-41fb-948e-db66120d5a4f => generated 109 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 08:37:58.547398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f0a6e297-5ba3-447a-816c-d41fc377f7e2 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.834286 Sep 28 08:37:58.548084 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 1/9] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Sep 28 08:37:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3838 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 08:37:58.580364 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0205c1a7-4e11-4132-a274-d5284b87311a tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Calling method '.version_select at 0x7f9854a7bd30>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:37:58.755492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0205c1a7-4e11-4132-a274-d5284b87311a tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805" status: 200 len: 353 microversion: 2.1 time: 0.184947 Sep 28 08:37:58.756529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 9/10] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:37:58 2022] GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:37:59.780083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c1908c13-4324-4a21-8af6-b42a2fee9499 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Calling method '.version_select at 0x7f9854b0f430>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:37:59.919899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c1908c13-4324-4a21-8af6-b42a2fee9499 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805" status: 200 len: 353 microversion: 2.1 time: 0.147147 Sep 28 08:37:59.920811 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 2/11] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:37:59 2022] GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:00.937225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0806e8c2-1448-46a8-9ddc-6e69739c19a0 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Calling method '.version_select at 0x7f9854a2e3a0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:01.081370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0806e8c2-1448-46a8-9ddc-6e69739c19a0 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805" status: 200 len: 354 microversion: 2.1 time: 0.148265 Sep 28 08:38:01.083015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 10/12] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:38:00 2022] GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:01.097065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-791dca0c-3ae6-42c4-9844-5ed4e3f6fd7f tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Calling method '.version_select at 0x7f9854b0faf0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:01.242337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-791dca0c-3ae6-42c4-9844-5ed4e3f6fd7f tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805" status: 200 len: 354 microversion: 2.1 time: 0.149236 Sep 28 08:38:01.243072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 3/13] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:38:01 2022] GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:01.268270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-84964557-bd52-4a66-9664-2eb195f7b0c1 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Calling method '.version_select at 0x7f9854a390d0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:01.576606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-84964557-bd52-4a66-9664-2eb195f7b0c1 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805" status: 202 len: 0 microversion: 2.1 time: 0.315414 Sep 28 08:38:01.578020 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 11/14] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:38:01 2022] DELETE /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:38:01.586466 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8c233cb3-70a3-4f7a-81ae-b89be1cfa7a0 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Calling method '.version_select at 0x7f9854aa91f0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:01.681915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8c233cb3-70a3-4f7a-81ae-b89be1cfa7a0 tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805" status: 200 len: 353 microversion: 2.1 time: 0.099782 Sep 28 08:38:01.683148 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 4/15] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:38:01 2022] GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:02.697899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9b0b26bf-f00c-46e5-b2b2-30e49bee0d6a tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Calling method '.version_select at 0x7f9854a2e4c0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:02.750375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-9b0b26bf-f00c-46e5-b2b2-30e49bee0d6a tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] HTTP exception thrown: Volume 32bace9b-21a0-4344-b6b0-66b66ccde805 could not be found. Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9b0b26bf-f00c-46e5-b2b2-30e49bee0d6a tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Request method failure captured: Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 HTTP/1.1 Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAfi0y5UK9Cr2QAzgOfBJt3nUdnQ37LG00zf6sD8hVCsIR6y2nD2mzjH8DXRzztBRUy-ItsLQ9vgMGeOFnQneRYP4lksy24OeyrCm51In7ZlUcTIvlo4D7zVociPNZYpPNfPULmWVnYMcMID_nOxVHTMw4qhsZrKWB0vznNhjFWRcgI Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: e7e1bfaf89844022baefa9fa51128e9a Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesGetTestJSON-1404896305 Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:38:02.752503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e7e1bfaf89844022baefa9fa51128e9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7e1bfaf89844022baefa9fa51128e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e7e1bfaf89844022baefa9fa51128e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e7e1bfaf89844022baefa9fa51128e9a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesGetTestJSON-1404896305 Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: e7e1bfaf89844022baefa9fa51128e9a Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesGetTestJSON-1404896305 Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesGetTestJSON-1404896305-project Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: bbd861e3414c4b5f9f9a68f3f303a9f2 Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesGetTestJSON-1404896305-project Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Volume 32bace9b-21a0-4344-b6b0-66b66ccde805 could not be found. Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '32bace9b-21a0-4344-b6b0-66b66ccde805'} Sep 28 08:38:02.753593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32bace9b-21a0-4344-b6b0-66b66ccde805 could not be found. (HTTP 404) (Request-ID: req-eab61371-e0c9-45c7-9ff6-e115a0c69ae6) Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:38:02.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:38:02.755041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32bace9b-21a0-4344-b6b0-66b66ccde805 could not be found. Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 08:38:02.755904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32bace9b-21a0-4344-b6b0-66b66ccde805 could not be found. Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32bace9b-21a0-4344-b6b0-66b66ccde805 could not be found. Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9b0b26bf-f00c-46e5-b2b2-30e49bee0d6a tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] Returning 404 to user: Volume 32bace9b-21a0-4344-b6b0-66b66ccde805 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:38:02.756804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9b0b26bf-f00c-46e5-b2b2-30e49bee0d6a tempest-VolumesGetTestJSON-1404896305 tempest-VolumesGetTestJSON-1404896305-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805" status: 404 len: 109 microversion: 2.1 time: 0.060464 Sep 28 08:38:02.760780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 12/16] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:38:02 2022] GET /compute/v2.1/os-volumes/32bace9b-21a0-4344-b6b0-66b66ccde805 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:38:14.006470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-226615084", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "networks": [{"uuid": "93671831-ef1f-495e-a41a-678e1dc193fe"}]}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:14.230890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c564ba1c-76bb-409d-b5b6-5abb964bb9fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'create', calling method: .version_select at 0x7f9854a7bb80>, body: {"keypair": {"name": "tempest-keypair-445120533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbh5N8tdht6Yul25XoEoOhJhf+RLx4rw3ygZALPy7TlSBhwMHJS5SHBMNznbFtfTMbFskyWPXp5qoLfneBcRx3BE4OuhnlQfzQ8QnF67XMQJ3ROFLnC+nAYtqMUgVzYrA=="}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:14.251118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] validate_networks() for [('93671831-ef1f-495e-a41a-678e1dc193fe', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:38:14.382699 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-c564ba1c-76bb-409d-b5b6-5abb964bb9fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for project d3e65d28e5664025978902943452f338. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:38:14.403922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-c564ba1c-76bb-409d-b5b6-5abb964bb9fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for user fe0fcdeafae645a582afcee3dde79ebc and project d3e65d28e5664025978902943452f338. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:38:14.522537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c564ba1c-76bb-409d-b5b6-5abb964bb9fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.418165 Sep 28 08:38:14.532168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 13/17] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:38:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:15.452681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1286616292", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:15.660948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] validate_networks() for [('ecfbeafd-1446-46f2-889b-466b351133a2', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:38:17.253467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:38:17.254277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:38:17.255154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:38:17.255905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:38:17.262382 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:38:17.319440 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:17.321188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:17.322924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:17.325236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:17.326782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:17.327701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:17.436927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Getting quotas for project dc7abcbb99b7466fb1581e1010b4a7e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:38:17.452074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Getting quotas for user 9369796f4c5b41d6b9fe1e786fbd4b38 and project dc7abcbb99b7466fb1581e1010b4a7e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:38:17.478430 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:38:17.485144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:38:17.693494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4f4ed76e-c73b-41b0-85c9-fb18e2031941 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.403982 Sep 28 08:38:17.711156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 5/18] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:38:17.719960 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-44faaa8e-2855-4ee8-b60d-a6687e3f875f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:17.720805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-44faaa8e-2855-4ee8-b60d-a6687e3f875f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:17.911873 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-44faaa8e-2855-4ee8-b60d-a6687e3f875f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:17.962950 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-44faaa8e-2855-4ee8-b60d-a6687e3f875f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1214 microversion: 2.1 time: 0.248072 Sep 28 08:38:17.970852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 6/19] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:17 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:19.164214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-64a34011-53ea-4154-ae73-e7e488c8ff46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: .version_select at 0x7f98541d1790>, body: {"keypair": {"name": "tempest-keypair-174439730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFSuH5m04B9cCfj5l8YV8iiRSzR6SZIrZOW+da27RFB2GkVbE5l4xMbt2TYmAdK03uLp7rXw+X34iyU2qF0A0A55AA3RqgIcqh316l413qh7fVZ2mmzyMNTQv4Bh71mVA=="}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:19.292251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-64a34011-53ea-4154-ae73-e7e488c8ff46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:38:19.310212 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-64a34011-53ea-4154-ae73-e7e488c8ff46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:38:19.456082 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-64a34011-53ea-4154-ae73-e7e488c8ff46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.430971 Sep 28 08:38:19.462958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 7/20] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:38:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:19.481716 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5a3ce757-dcc7-4527-be14-9415d1eefa4a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:19.495647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5a3ce757-dcc7-4527-be14-9415d1eefa4a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:19.756106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:38:19.756713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:38:19.757290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:38:19.757725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:38:19.758313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:38:19.815507 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:19.816118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:19.818509 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:19.821431 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:19.827566 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:19.828337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:20.012113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for project 42699952850d49fdafb670aeb5f613ed. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:38:20.046732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for user 7d712e201f2c47a8a48b6e24559e0d60 and project 42699952850d49fdafb670aeb5f613ed. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:38:20.173919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:38:20.184933 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:38:20.650000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5a3ce757-dcc7-4527-be14-9415d1eefa4a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:20.692500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5a3ce757-dcc7-4527-be14-9415d1eefa4a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1214 microversion: 2.1 time: 1.226294 Sep 28 08:38:20.697562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 8/21] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:19 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1214 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:20.728669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e146ea3f-fff8-4b97-97e5-6f2b17614b0b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.191665 Sep 28 08:38:20.732951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 14/22] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:38:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 6199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:38:20.747474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c70c24ca-c68e-41bb-af53-474fdf3acc7b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:20.749192 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c70c24ca-c68e-41bb-af53-474fdf3acc7b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:21.067145 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c70c24ca-c68e-41bb-af53-474fdf3acc7b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:21.078243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c70c24ca-c68e-41bb-af53-474fdf3acc7b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1222 microversion: 2.1 time: 0.334733 Sep 28 08:38:21.101131 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 9/23] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:20 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1222 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:21.457755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1370398011", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:21.567611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] validate_networks() for [('ecfbeafd-1446-46f2-889b-466b351133a2', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:38:21.723771 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:21.724734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:21.748632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:21.749183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:21.749626 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:21.766754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:21.766754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:21.767084 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:22.331851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:22.351793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-606cd763-7fa1-4952-b269-77258fa5a604 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1210 microversion: 2.1 time: 0.631973 Sep 28 08:38:22.358139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 10/24] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:21 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1210 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:23.384735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:23.385734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:23.395711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:23.396216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:23.396663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:23.410991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:23.415925 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:23.417733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:23.785781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:23.798447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-42b04468-6a21-478e-878f-fa4902297086 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1272 microversion: 2.1 time: 0.418355 Sep 28 08:38:23.802404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 11/25] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:23 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1272 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:24.246243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-892123746", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff034301-a1c4-4028-a91c-012c3b139427"}], "security_groups": [{"name": "tempest-securitygroup--2021398016"}], "key_name": "tempest-keypair-445120533", "user_data": "}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:24.327651 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:38:24.327651 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:38:24.328091 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:38:24.328502 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:38:24.329153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:38:24.376950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:24.377486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:24.377946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:24.378717 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:24.379404 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:24.380914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:24.428190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for project 42699952850d49fdafb670aeb5f613ed. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:38:24.433939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for user 7d712e201f2c47a8a48b6e24559e0d60 and project 42699952850d49fdafb670aeb5f613ed. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:38:24.448812 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:38:24.453268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:38:24.576674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3bc380b8-306d-448a-ba5f-edf50223889b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.124187 Sep 28 08:38:24.579037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 15/26] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:38:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 08:38:24.596122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-62bf2ece-ecc3-4a9f-96d8-1a58884fc625 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:24.598402 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-62bf2ece-ecc3-4a9f-96d8-1a58884fc625 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:25.298229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-62bf2ece-ecc3-4a9f-96d8-1a58884fc625 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:25.351080 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-62bf2ece-ecc3-4a9f-96d8-1a58884fc625 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1222 microversion: 2.1 time: 0.764221 Sep 28 08:38:25.352538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 16/27] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:24 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1222 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:25.373690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:25.387598 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:25.409621 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:25.422386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:25.423073 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:25.428755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:25.429634 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:25.430545 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:25.750969 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] validate_networks() for [('ff034301-a1c4-4028-a91c-012c3b139427', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:38:27.393774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:27.419146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:27.461712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-44e34b5c-c071-4ede-9c43-75c4e90ad748 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1272 microversion: 2.1 time: 2.099066 Sep 28 08:38:27.463208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 17/28] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:25 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1272 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:27.470542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:27.471433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:27.480819 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:27.481705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:27.482668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:27.484839 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:27.485701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:27.486333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:27.869220 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:27.902555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4e26ecc6-a9d5-479f-87d7-779afe04055d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1274 microversion: 2.1 time: 0.437660 Sep 28 08:38:27.921630 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 18/29] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:27 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1274 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:28.239584 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1498661375", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5328add-2390-4470-bd9d-0ff97db6e42c"}], "security_groups": [{"name": "tempest-securitygroup--951590653"}], "key_name": "tempest-keypair-174439730", "user_data": "}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:29.846716 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] validate_networks() for [('b5328add-2390-4470-bd9d-0ff97db6e42c', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:38:31.073849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=16 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:31.726996 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:38:31.727858 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:38:31.728493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:38:31.729074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:38:31.729674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:38:31.743213 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:31.745882 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:31.751238 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:31.759107 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:31.759845 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:31.762505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:31.839012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for project d3e65d28e5664025978902943452f338. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:38:31.850561 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for user fe0fcdeafae645a582afcee3dde79ebc and project d3e65d28e5664025978902943452f338. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:38:31.893219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:38:31.900335 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:38:32.033506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-18bf0114-3874-4e23-b3ec-4fc3348dddb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.793391 Sep 28 08:38:32.034406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 12/30] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:38:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 7795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 08:38:32.058527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:32.061241 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:32.070150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:32.070795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:32.071348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:32.072298 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:32.072908 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:32.073494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:33.770510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:33.780797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1a7bf6db-6f3e-4660-86f6-a1dc6771fb27 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 1.731411 Sep 28 08:38:33.789609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 13/31] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:32 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:33.808738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:33.813965 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:33.847072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:33.847604 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:33.848217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:33.849058 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:33.849950 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:33.850606 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:34.148513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:34.161066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ffaa39b0-0ac8-49ce-ac78-94439c7581b6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1280 microversion: 2.1 time: 0.358176 Sep 28 08:38:34.171011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 14/32] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:33 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1280 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:34.176327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:34.182087 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:34.217230 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:34.220594 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:34.223195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:34.227373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:34.235805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:34.236689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:34.398491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=4 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:34.843926 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:34.860587 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7943c25a-6f0c-4cc5-97c5-712a516db204 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1288 microversion: 2.1 time: 0.684803 Sep 28 08:38:34.862252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 15/33] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:34 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1288 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:34.899814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:34.900996 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:34.931980 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:34.933866 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:34.937209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:34.942597 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:34.945585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:34.946905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:35.328778 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=18 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:36.152264 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:36.175917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-70126419-672b-4f76-8520-5d79ae1bba99 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 1.311310 Sep 28 08:38:36.176464 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 16/34] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:34 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:36.203128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:36.211097 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:36.241348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:36.243698 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:36.250132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:36.256914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:36.260359 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:36.261136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:36.923979 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:36.937658 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-89d93d72-94a1-456f-bfcd-70dcc5e2580e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.744918 Sep 28 08:38:36.939062 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 17/35] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:36 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:36.956524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:36.958816 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:36.979315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:38:36.980818 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:38:36.983049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:36.984558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:38:36.985005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:36.985727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:36.987632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:36.988087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:38:36.988824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:36.991360 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:36.992227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:38:37.057423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:37.075191 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:37.076140 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:37.080120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:37.083907 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:37.093709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:37.144577 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:38:37.156806 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:38:37.186817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:38:37.191207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:38:37.309356 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b710220e-22a7-4a78-87be-aded2d661bed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 9.078613 Sep 28 08:38:37.316210 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 19/36] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:38:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 9081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 08:38:37.392314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:37.407806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bf0374ec-f9c4-4d62-8c79-bc04ffeed964 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1294 microversion: 2.1 time: 0.461651 Sep 28 08:38:37.408664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 18/37] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:36 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1294 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:37.420257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:37.421278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:37.453469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:37.459161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:37.459857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:37.462330 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:37.468303 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:37.469152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:37.995304 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-b7784f47-42dc-4aa1-bd2f-167c24ff546b req-d16e7d92-debd-4e4e-b58e-7a1633b72bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d33c275-10df-4eb8-90a9-e31c4a6f9cb6", "tag": "d4344f22-bad7-4ad7-8549-d8b5a9bbb4e5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:38.052063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b7784f47-42dc-4aa1-bd2f-167c24ff546b req-d16e7d92-debd-4e4e-b58e-7a1633b72bf9 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:38.052564 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b7784f47-42dc-4aa1-bd2f-167c24ff546b req-d16e7d92-debd-4e4e-b58e-7a1633b72bf9 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:38.053020 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b7784f47-42dc-4aa1-bd2f-167c24ff546b req-d16e7d92-debd-4e4e-b58e-7a1633b72bf9 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:38.154107 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-b7784f47-42dc-4aa1-bd2f-167c24ff546b req-d16e7d92-debd-4e4e-b58e-7a1633b72bf9 service nova] Creating event network-changed:d4344f22-bad7-4ad7-8549-d8b5a9bbb4e5 for instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 on hv-cinder-84456 Sep 28 08:38:38.167815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b7784f47-42dc-4aa1-bd2f-167c24ff546b req-d16e7d92-debd-4e4e-b58e-7a1633b72bf9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 08:38:38.168342 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b7784f47-42dc-4aa1-bd2f-167c24ff546b req-d16e7d92-debd-4e4e-b58e-7a1633b72bf9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 08:38:38.176942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:38.177539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:38.178106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:38.178795 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:38.179344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:38.179685 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:38.222126 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.compute.rpcapi [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 08:38:38.244981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] Releasing lock "compute-rpcapi-router" {{(pid=127111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 08:38:38.293721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-42bf9325-3cf0-4105-80ce-69f1ef00b2fe None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.978108 Sep 28 08:38:38.298609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 20/38] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:38.320917 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a14c5c68-649f-43a4-8635-83ba607e520c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:38.322005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a14c5c68-649f-43a4-8635-83ba607e520c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:38.403544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:38.413081 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-586c92f5-1294-48f3-91b5-0e9c74b9e82d tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 1.002985 Sep 28 08:38:38.420704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 19/39] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:37 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:38.426143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:38.442096 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:38.456505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:38.457043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:38.457575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:38.458296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:38.458805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:38.459314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:38.565334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a14c5c68-649f-43a4-8635-83ba607e520c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:38.576552 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a14c5c68-649f-43a4-8635-83ba607e520c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1241 microversion: 2.1 time: 0.276258 Sep 28 08:38:38.589143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 21/40] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:38 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1241 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:38.589143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:38.589143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:38.608347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:38.609295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:38.610005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:38.610969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:38.611682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:38.612371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:38.862796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:38.870727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-72fb992e-d2d2-4bdb-b093-6756f64ac8a1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1294 microversion: 2.1 time: 0.291789 Sep 28 08:38:38.871594 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 22/41] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:38 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1294 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:39.016914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:39.044012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-00fc4b64-5516-4eb7-9522-30097cc6b1e1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.621593 Sep 28 08:38:39.047617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 20/42] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:38 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:39.449292 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:39.450003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:39.459886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:39.461455 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:39.465021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:39.466902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:39.468613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:39.470958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:39.611766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:39.612386 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:39.621231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:39.621742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:39.628406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:39.633758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:39.643072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:39.644035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:39.837933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:39.848243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-aea8e56b-55ae-469b-b1f2-f266a6819162 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1237 microversion: 2.1 time: 0.241401 Sep 28 08:38:39.849393 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 21/43] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:39 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1237 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:39.869048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:39.882959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-75b0c545-30fe-4aa6-8dd2-eefaad4fd454 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.438151 Sep 28 08:38:39.899665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 23/44] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:39 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:39.901595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:39.902240 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:39.917798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:39.918302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:39.918744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:39.920091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:39.920553 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:39.920984 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.085168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-aabe91f3-00ea-4f7c-a761-4846c38b991f req-f40bf63b-d1fb-4bd8-9ffb-121b9ae72406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53562009-e64b-47ed-8dd7-890647fe3e44", "tag": "f6ac07f3-2675-41dc-968c-7b86388bb047"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:40.091822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:40.099394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-aabe91f3-00ea-4f7c-a761-4846c38b991f req-f40bf63b-d1fb-4bd8-9ffb-121b9ae72406 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:40.100168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-aabe91f3-00ea-4f7c-a761-4846c38b991f req-f40bf63b-d1fb-4bd8-9ffb-121b9ae72406 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:40.100614 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-aabe91f3-00ea-4f7c-a761-4846c38b991f req-f40bf63b-d1fb-4bd8-9ffb-121b9ae72406 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.101305 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ead7f912-dcc7-4f7d-83a2-da42b87558df tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.210084 Sep 28 08:38:40.110177 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 22/45] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:39 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:40.116140 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-aabe91f3-00ea-4f7c-a761-4846c38b991f req-f40bf63b-d1fb-4bd8-9ffb-121b9ae72406 service nova] Creating event network-changed:f6ac07f3-2675-41dc-968c-7b86388bb047 for instance 53562009-e64b-47ed-8dd7-890647fe3e44 on hv-cinder-84456 Sep 28 08:38:40.121884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:40.122576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:40.122777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-aabe91f3-00ea-4f7c-a761-4846c38b991f req-f40bf63b-d1fb-4bd8-9ffb-121b9ae72406 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156031 Sep 28 08:38:40.123550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 24/46] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:38:40.129080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:40.129578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:40.130037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.130984 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:40.131590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:40.132047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.306851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:40.316852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-15682bc0-e528-43bf-badf-6a6c677bae2c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.205356 Sep 28 08:38:40.335814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 23/47] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:40 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:40.876715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:40.877545 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:40.883913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:40.884487 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:40.885010 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.885884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:40.886400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:40.886890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.908543 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:40.910665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:40.917482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:40.918309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:40.918985 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.919936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:40.920600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:40.921275 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:40.964543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:40.972222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b58f0430-4847-487b-b3d8-62abbfaf802f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1237 microversion: 2.1 time: 0.100161 Sep 28 08:38:40.972790 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 25/48] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:40 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1237 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:41.109042 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:41.125888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-41f8384f-676f-404b-b14e-1ef936ede3d0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.222886 Sep 28 08:38:41.133368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:41.133368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:41.137083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 24/49] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:40 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:41.141036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:41.143561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:41.144194 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:41.145142 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:41.145795 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:41.146323 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:41.332932 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:41.342084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-de30bf2c-4b11-4717-88ad-5375481a53cb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.220231 Sep 28 08:38:41.342277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:41.342654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 26/50] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:41 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:41.342851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:41.350144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:41.350784 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:41.351223 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:41.352264 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:41.356540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:41.357663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:41.587069 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:41.597411 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e3be9bd1-353c-49cf-96c5-11ee2c6fa46f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.258887 Sep 28 08:38:41.602143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 25/51] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:41 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:41.999159 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:42.006676 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:42.013999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.014834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.015556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.016970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.017663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.018371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.099081 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:42.110124 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f14e1592-bf07-456f-8464-f49d1317cf8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1237 microversion: 2.1 time: 0.118680 Sep 28 08:38:42.111028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 27/52] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:41 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1237 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:42.144817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-0bc3f519-d81c-4f14-891e-eafb45b8b520 req-faa7646b-055f-48bb-b4e1-9acdc8ea8878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d58d7457-5855-4349-876d-c208e237594e", "tag": "6a3b0562-aa67-4f66-a0ad-66e753e42296"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:42.155558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:42.156953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:42.170712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.172270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:42.173276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:42.177119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0bc3f519-d81c-4f14-891e-eafb45b8b520 req-faa7646b-055f-48bb-b4e1-9acdc8ea8878 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.179975 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0bc3f519-d81c-4f14-891e-eafb45b8b520 req-faa7646b-055f-48bb-b4e1-9acdc8ea8878 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.180423 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0bc3f519-d81c-4f14-891e-eafb45b8b520 req-faa7646b-055f-48bb-b4e1-9acdc8ea8878 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.198027 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.203657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.205588 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.213416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-0bc3f519-d81c-4f14-891e-eafb45b8b520 req-faa7646b-055f-48bb-b4e1-9acdc8ea8878 service nova] Creating event network-changed:6a3b0562-aa67-4f66-a0ad-66e753e42296 for instance d58d7457-5855-4349-876d-c208e237594e on hv-cinder-84456 Sep 28 08:38:42.213987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0bc3f519-d81c-4f14-891e-eafb45b8b520 req-faa7646b-055f-48bb-b4e1-9acdc8ea8878 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 28 08:38:42.214580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0bc3f519-d81c-4f14-891e-eafb45b8b520 req-faa7646b-055f-48bb-b4e1-9acdc8ea8878 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 28 08:38:42.215128 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.215700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.216634 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.217730 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.218738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.219665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.220154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.220799 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.232411 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.compute.rpcapi [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 28 08:38:42.233904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] Releasing lock "compute-rpcapi-router" {{(pid=127110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 28 08:38:42.255164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-44604e37-a690-4f09-9d0c-2c40deefe686 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114377 Sep 28 08:38:42.256408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 26/53] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:42.371361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:42.372085 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:42.396130 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.399677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.400849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.401907 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.404032 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.405627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.438160 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:42.718843 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:42.733700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3eb55b7f-5521-49b6-9ae8-2f4a48082696 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.585394 Sep 28 08:38:42.734898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 28/54] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:42 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:42.746586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:42.747760 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:42.778289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.786028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.787297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.789357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:42.790379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:42.792888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:42.794003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:42.806054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9cff62ea-f501-4f50-9a90-0ba07cf9afa0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.439376 Sep 28 08:38:42.807278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 27/55] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:42 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:43.119049 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:43.133129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-28ea0d10-c2a1-432b-8343-e4f4a61571ba tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.396710 Sep 28 08:38:43.133974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 29/56] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:42 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:43.136175 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:43.136885 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:43.143956 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:43.144453 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:43.144894 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:43.145629 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:43.146091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:43.146521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:43.216143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:43.224208 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ed4bc452-e25f-48b6-a992-f7bd7b1951a5 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.092280 Sep 28 08:38:43.224840 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 28/57] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:43 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:43.509510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-4dce1bc8-a7de-47d2-80d7-2de0533d50e2 req-0bc19fe0-d5ad-4793-81ce-35bb0c62a26e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf04325-2791-450a-8f0c-7ab39f891ec4", "tag": "c6a4b931-a59a-4621-8e16-7c3e343a1e8a"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:38:43.522504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-4dce1bc8-a7de-47d2-80d7-2de0533d50e2 req-0bc19fe0-d5ad-4793-81ce-35bb0c62a26e service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:43.522992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-4dce1bc8-a7de-47d2-80d7-2de0533d50e2 req-0bc19fe0-d5ad-4793-81ce-35bb0c62a26e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:43.523427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-4dce1bc8-a7de-47d2-80d7-2de0533d50e2 req-0bc19fe0-d5ad-4793-81ce-35bb0c62a26e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:43.540435 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-4dce1bc8-a7de-47d2-80d7-2de0533d50e2 req-0bc19fe0-d5ad-4793-81ce-35bb0c62a26e service nova] Creating event network-changed:c6a4b931-a59a-4621-8e16-7c3e343a1e8a for instance bdf04325-2791-450a-8f0c-7ab39f891ec4 on hv-cinder-84456 Sep 28 08:38:43.546140 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-4dce1bc8-a7de-47d2-80d7-2de0533d50e2 req-0bc19fe0-d5ad-4793-81ce-35bb0c62a26e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040229 Sep 28 08:38:43.546736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:38:43.771744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:43.772359 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:43.774257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:43.780073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:43.780594 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:43.781328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:43.784431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:43.784952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:43.785418 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:43.852793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:43.853767 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:43.861375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:43.862044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:43.862565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:43.863369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:43.864299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:43.864886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:43.981133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:43.990329 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fb44ccf6-f699-4440-a19b-165c16cae6ea tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.222284 Sep 28 08:38:43.990915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 29/59] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:43 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:44.035040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:44.043285 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1640a0d8-0515-41b1-bca3-1b350b4c8353 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.194890 Sep 28 08:38:44.043865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 31/60] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:43 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:44.158512 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:44.166178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:44.166178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:44.166178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:44.166780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:44.167061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:44.167507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:44.167931 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:44.250567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:44.251217 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:44.253363 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:44.259086 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:44.259750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:44.260365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:44.261080 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:44.261560 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:44.261981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:44.268084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=75 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:44.344182 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:44.349679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:44.352081 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4d9e8aba-28b2-4807-98e5-0893a3f5f36f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.106605 Sep 28 08:38:44.352664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 32/61] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:44 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:44.374079 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5cb01af4-d137-4b2a-ba3d-23717fe3b909 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.219199 Sep 28 08:38:44.375246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 30/62] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:44 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:45.012728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:45.013383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:45.020184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.020675 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.021125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.022004 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.022459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.022885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.067204 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:45.067824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:45.074045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.074815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.074974 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.075685 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.076143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.076570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.211539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:45.221528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5d17ac59-f4ed-45a9-8fdd-7dd9b14391c3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.212550 Sep 28 08:38:45.222629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 33/63] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:45 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:45.288535 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:45.298936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9a2e070a-4833-485a-ac1b-802bac7b3cdd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.235569 Sep 28 08:38:45.299893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 31/64] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:45 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:45.380073 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:45.380936 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:45.388599 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.389420 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.390164 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.398253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:45.398952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:45.407204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.407886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.408330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.410563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.411475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.412101 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.414392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:45.417172 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:45.417799 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:45.543537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:45.555575 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b36b40fe-c271-473a-a4a4-b336eaef768f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.182380 Sep 28 08:38:45.557167 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 34/65] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:45 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:45.680134 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:45.695891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6c3ef366-6f7c-4429-aab0-7832e516029d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.302639 Sep 28 08:38:45.699965 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 32/66] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:45 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:46.245796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:46.246415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:46.252964 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.253615 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.254051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:46.254851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.255309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.255732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:46.323865 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:46.326234 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:46.331830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.332501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.333011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:46.334243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.334698 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.335133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:46.828521 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:46.843284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-40186d71-d87f-4b03-a5e2-93c356414a56 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.600985 Sep 28 08:38:46.844668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 35/67] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:46 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:46.852938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:46.854490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:46.865643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.867516 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.868309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:46.869638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.870492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.871501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:46.966563 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:46.974052 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:46.975048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f231bd75-0a2b-4bcc-8595-c3497298518f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.128648 Sep 28 08:38:46.975702 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 36/68] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:46 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:46.980558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:46.981297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:46.985348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-302a25d7-f40a-4745-a7e8-495ae61e43d2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.665313 Sep 28 08:38:46.986204 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 33/69] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:46 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:46.989077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.989077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.989394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:46.990220 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:46.990755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:46.991262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:47.155813 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:47.167726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-270477ab-03d3-4856-86b2-8c832b55220e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.190764 Sep 28 08:38:47.168590 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 37/70] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:46 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:47.875991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:47.876605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:47.882500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:47.882987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:47.883422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:47.884114 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:47.884572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:47.885004 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:48.006915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:48.007534 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:48.014970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:48.015470 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:48.015912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:48.016984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:48.017631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:48.018964 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:48.023003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:48.031054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4116dcae-16b1-4e6f-8916-079d15102cd1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.159499 Sep 28 08:38:48.031845 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 34/71] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:47 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:48.036854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:48.037486 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:48.043772 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:48.044761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:48.045402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:48.046050 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:48.046672 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:48.047121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:48.086879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:48.094875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7475761a-f38f-426b-9e63-1073ac545174 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.091882 Sep 28 08:38:48.095450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 38/72] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:48 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:48.191014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:48.195989 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:48.196610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:48.200884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bb64bdd1-5a68-4f4a-b47b-b2ea11039f92 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.167668 Sep 28 08:38:48.201818 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 35/73] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:48 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:48.202779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:48.203286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:48.204309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:48.205063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:48.205632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:48.206055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:48.224375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=4 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:48.366247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:48.374125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-26210cb5-3a58-4625-b3f5-2fa10633fea7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.182440 Sep 28 08:38:48.374919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 39/74] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:48 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:49.055412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:49.056096 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:49.062506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.062977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.063407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.064082 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.064526 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.064959 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.118404 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:49.119012 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:49.120822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=8 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:49.127169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.127658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.128097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.128791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.129269 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.129692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.201358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:49.212169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-568d025d-c9bd-4946-8549-f521a111607b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.095084 Sep 28 08:38:49.212801 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 40/75] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:49 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:49.224634 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:49.225473 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:49.226585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:49.231589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.232081 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.232517 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.233248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.233725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.234145 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.235866 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-07e27e5d-b772-41ad-9e93-95605c9d0ac9 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.183884 Sep 28 08:38:49.236863 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 36/76] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:49 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:49.361295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:49.368793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-284ba9b1-10ba-4e89-8fdc-b6dfe391cf49 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.148518 Sep 28 08:38:49.369384 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 41/77] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:49 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:49.398183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:49.398479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:49.404635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.405170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.405604 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.406296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:49.406747 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:49.407472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:49.555686 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:49.564000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c2f81d9b-fae6-435a-adda-1894b876eb28 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.170051 Sep 28 08:38:49.564617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 37/78] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:49 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:50.235501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:50.236116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:50.242120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.242610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.243056 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.243745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.244204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.244628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.260828 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:50.261475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:50.267822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.268324 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.268762 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.269486 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.270059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.270554 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.305060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:50.312845 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3f495c58-dc44-4b6f-8324-5e3f70bb81dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.081229 Sep 28 08:38:50.313445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 42/79] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:50 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:50.392647 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:50.393291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:50.399400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.399862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:50.399994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.400347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.401058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.401544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.401979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.407832 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9ebd7142-2537-468b-92d1-be3c92869606 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.150773 Sep 28 08:38:50.408396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 38/80] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:50 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:50.537614 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:50.545378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6db71eb2-93cf-405a-a6a7-09b1f835bec4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.157351 Sep 28 08:38:50.545976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 43/81] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:50 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:50.586756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:50.587374 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:50.593855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.594351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.594791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.595511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:50.595972 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:50.596400 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:50.739787 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:50.747445 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-60e298b0-e587-483a-8d42-02f6f6f19d1c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.164669 Sep 28 08:38:50.748008 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 39/82] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:50 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:51.335514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:51.336121 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:51.342182 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.343187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.343599 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.344281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.344828 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.345330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.409624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:51.417967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-76ef20b1-8c95-4b04-9be7-de40ecf3bedd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.086296 Sep 28 08:38:51.418526 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 44/83] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:51 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:51.431688 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:51.432821 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:51.440544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.441058 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.441533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.442262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.442715 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.443141 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.577654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:51.577654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:51.582374 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.582884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.583321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.584043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.584495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.584925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.594262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:51.604605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2f9ad1fa-5c5a-4ee1-869e-4c99eb6b0638 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.178736 Sep 28 08:38:51.605210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 40/84] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:51 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:51.711352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:51.719844 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3bc8d053-86bb-472a-8a96-4be70fcca97e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.153790 Sep 28 08:38:51.720408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 45/85] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:51 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:51.772358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:51.773064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:51.780848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.781373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.781889 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.783009 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:51.783475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:51.784119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:51.920445 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:51.927923 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9ac3b7dd-bd08-4a85-81ec-84e0b67897f3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.160543 Sep 28 08:38:51.928477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 41/86] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:51 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:52.442187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:52.442641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:52.448778 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.449302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.449768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:52.450457 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.450903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.451326 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:52.519620 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:52.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bb6116c6-3649-4f7f-befb-270f0f487e4a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.090199 Sep 28 08:38:52.533990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 46/87] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:52 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:52.627363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:52.628030 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:52.632218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:52.635102 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.635639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.636135 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:52.636903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.637422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.637866 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:52.744146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:52.744833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:52.751157 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.751946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.752447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:52.753272 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.753793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.754647 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:52.777342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:52.790754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ea57be65-87b5-4345-b867-3e01ae934535 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.167359 Sep 28 08:38:52.791630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 42/88] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:52 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:52.898622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:52.907288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2b769a5f-843f-44e7-aede-6b1c62f4404b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.168988 Sep 28 08:38:52.907926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 47/89] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:52 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:52.950883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:52.951518 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:52.957834 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.958316 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.958744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:52.959419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:52.959866 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:52.960285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:53.086077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:53.089384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:53.094857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-27afeef9-2de9-4349-ba39-311b7bcd4226 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.147760 Sep 28 08:38:53.095424 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 43/90] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:52 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:53.556925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:53.557564 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:53.564601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:53.565108 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:53.565560 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:53.566259 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:53.566713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:53.567138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:53.628039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:53.630233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:38:53.636624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4796e02f-3cf0-48b8-93e3-789c4952dd9a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.083563 Sep 28 08:38:53.637202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 48/91] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:53 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:53.819734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:53.820376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:53.826377 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:53.826872 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:53.827376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:53.828073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:53.828527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:53.828958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:53.931347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:53.932475 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:53.941607 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:53.942439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:53.942969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:53.943745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:53.944261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:53.944748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:53.970217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:53.978157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4a1b02e0-813e-41d1-bc64-de8bf5fdad48 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.163444 Sep 28 08:38:53.978859 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 44/92] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:53 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:54.075307 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:54.082820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9d513ab8-3b00-4f50-a5ad-82fe5026be3e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.155764 Sep 28 08:38:54.083383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 49/93] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:53 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:54.117271 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:54.117881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:54.123826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:54.124315 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:54.124788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:54.125531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:54.126001 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:54.126434 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:54.261043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:54.268752 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-55eeab93-5741-49d3-9a96-74493125ef09 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.155248 Sep 28 08:38:54.269400 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 45/94] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:54 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:54.659712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:54.660322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:54.666568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:54.667051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:54.667486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:54.668175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:54.668624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:54.669045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:54.730044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:54.738213 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2377fd94-27e3-4c7e-83c0-d5a80bb720f7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.082324 Sep 28 08:38:54.738762 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 50/95] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:54 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:55.001853 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:55.002481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:55.008460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.008943 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.009401 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.010092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.010534 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.010953 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.105375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:55.105980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:55.112364 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.112841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.113298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.113992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.114445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.114864 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.138136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:55.146265 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d821d69a-20c1-42e4-b09c-cbab9f634736 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.148298 Sep 28 08:38:55.146839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 46/96] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:54 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:55.246577 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:55.254043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8b145676-483d-432e-9eb8-122773ce8e3d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.152474 Sep 28 08:38:55.254622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 51/97] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:55 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:55.292621 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:55.293221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:55.299157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.299648 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.300094 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.300789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.301286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.301718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.430536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:55.439255 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6ffc10a2-899c-455f-b057-cb51afe9af4c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.151151 Sep 28 08:38:55.440142 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 47/98] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:55 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:55.762505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:55.763115 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:55.770024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.770235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.770617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.771235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:55.779592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:55.779592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:55.837977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:55.846154 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5303e09b-81b1-4264-bbaa-1866aa27c3c2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.088973 Sep 28 08:38:55.846726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 52/99] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:55 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:56.171513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:56.172123 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:56.177948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.178431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.178866 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.179550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.180000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.180516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.278301 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:56.278913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:56.285415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.286086 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.286525 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.287223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.287679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.288171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.313684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:56.324738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f3dac82a-d7c7-416f-8182-9267fbe86aa1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.157508 Sep 28 08:38:56.325700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 48/100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:56 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:56.418529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:56.426749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-414eb78c-c16f-4a44-9386-cc203a0c0c17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.152279 Sep 28 08:38:56.427310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 53/101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:56 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:56.462882 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:56.463495 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:56.469477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.469966 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.470406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.471096 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.471550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.471978 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.611860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:56.619589 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5cb8eef4-1b0a-46c0-afbd-ea9e94b92395 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.160507 Sep 28 08:38:56.620089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 49/102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:56 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:56.868893 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:56.869529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:56.877002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.877572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.878120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.878823 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:56.879270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:56.879690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:56.948867 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:56.959454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-970f81ee-2b72-445a-99a0-e48d855e098e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.094384 Sep 28 08:38:56.960122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 54/103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:56 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:57.347823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:57.348438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:57.355345 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.355891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.356344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:57.357085 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.357596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.358028 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:57.449875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:57.450707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:57.457855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.458346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.458783 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:57.459488 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.459940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.460368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:57.490763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:57.499903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c3900f4b-fffc-4d12-9ae8-447fac4431c0 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.154586 Sep 28 08:38:57.500157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 50/104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:57 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:57.592700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:57.600363 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9e8a8609-683e-49ff-85a6-1fce229acf80 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.154276 Sep 28 08:38:57.601132 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 55/105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:57 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:57.643722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:57.644326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:57.651394 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.652364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.652797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:57.653533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.653980 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.654403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:57.785881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:57.793794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d2eb8294-f8f5-4d6a-94fd-635fdec9bf52 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.153893 Sep 28 08:38:57.794347 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 51/106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:57 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:57.986258 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:57.986870 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:57.992872 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.993475 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.993911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:57.994607 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:57.995062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:57.995492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:58.058586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:58.066315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5b086dd7-025e-4aa5-95e8-6ed35bb84d6a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.084795 Sep 28 08:38:58.066881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 56/107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:57 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:58.523635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:58.524166 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:58.530469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:58.530947 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:58.531373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:58.532055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:58.532501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:58.532920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:58.623043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:58.623652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:58.629730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:58.630177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:58.630616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:58.631309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:58.631767 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:58.632187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:58.680780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:58.689344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3f7da4db-aafc-4cf6-a731-d2a81bd542d1 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.170902 Sep 28 08:38:58.689917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 52/108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:58 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:58.762448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:58.769971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c82251b5-f6ab-4de5-a248-7c0275aff6c4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.150779 Sep 28 08:38:58.770527 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 57/109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:58 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:38:58.817440 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:58.817970 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:58.823877 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:58.824361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:58.824794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:58.825530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:58.825992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:58.826419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:58.971452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:58.979287 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-694bfd4e-385d-4d58-9315-3430aec1b6df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.165763 Sep 28 08:38:58.979849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 53/110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:58 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:59.088877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:59.089443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:59.096036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:59.096523 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:59.096965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:59.097692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:59.098147 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:59.098571 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:59.160399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:59.168504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9013f5c2-88ce-4999-b4fa-bb377eef8fa4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.083370 Sep 28 08:38:59.169065 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 58/111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:59 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:59.712035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:59.712654 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:59.718846 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:59.719327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:59.719762 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:59.720447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:59.720901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:59.721365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:59.794540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:38:59.795136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:38:59.801694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:59.802177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:59.802606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:59.803296 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:38:59.803738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:38:59.804156 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:38:59.877384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:59.884891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-257e5fe4-7900-4cd2-8f05-b164dc383300 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.176619 Sep 28 08:38:59.885413 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 54/112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:59 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:38:59.953819 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:38:59.962117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d0a52cb1-b7f2-4879-b43d-fa63d78b307f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.171372 Sep 28 08:38:59.962677 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 59/113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:59 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:00.002632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:00.003245 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:00.009041 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.009569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.010010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:00.010707 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.011167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.011596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:00.145544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:00.153233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f7466de9-7669-4ba9-9b22-3124aacbd495 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.154948 Sep 28 08:39:00.153815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 55/114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:38:59 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:00.192687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:00.193332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:00.200141 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.200626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.201055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:00.201773 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.202219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.203202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:00.269538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:00.277660 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8b8ccb52-0ffb-4b6b-af15-7c870bf5766e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.088636 Sep 28 08:39:00.278232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 60/115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:00 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:00.908260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:00.908869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:00.915037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.915519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.915953 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:00.916641 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.917118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.917549 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:00.985036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:00.985688 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:00.991508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.991995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.992434 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:00.993152 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:00.993603 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:00.994028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:01.095199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:01.104318 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9cffca9d-5741-45e1-a225-34cee1236de4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.199611 Sep 28 08:39:01.111843 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 56/116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:00 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:01.146049 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:01.153545 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-05dd846b-245c-438f-9e4d-26682855db5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.172984 Sep 28 08:39:01.154094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 61/117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:00 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:01.176321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:01.176870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:01.182834 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:01.183309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:01.183771 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:01.184425 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:01.184874 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:01.185322 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:01.301595 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:01.302193 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:01.307999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:01.308477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:01.308906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:01.309622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:01.310126 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:01.310483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:01.318999 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:01.326787 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-640d13dd-7165-480c-a2c3-b49021bef086 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.154375 Sep 28 08:39:01.327938 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 57/118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:01 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:01.370715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:01.378119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a33f5520-de50-4426-a684-aedb8f2ce1fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.080361 Sep 28 08:39:01.378665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 62/119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:01 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:02.135165 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:02.136146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:02.143506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.144167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.144653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.145494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.146101 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.146624 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.176190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:02.176793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:02.188715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.189566 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.190488 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.191348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.191882 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.192533 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.344248 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:02.352497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7c35be06-f6f4-4cff-8c29-90a16cc3c03e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.223786 Sep 28 08:39:02.353171 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 58/120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:02 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:02.357778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:02.359058 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:02.364627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.365226 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.365727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.366475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.366997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.367474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.375667 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:02.383283 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9c7de797-3d09-46c7-9854-6b266717e937 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.210847 Sep 28 08:39:02.383843 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 63/121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:02 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:02.401051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:02.401683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:02.408769 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.409294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.409732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.410429 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:02.410880 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:02.411300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:02.485641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:02.493463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cf463d13-4e96-4884-8f84-ab2f5736df2f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1293 microversion: 2.1 time: 0.096258 Sep 28 08:39:02.494078 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 64/122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:02 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:02.521022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:02.532163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-faf2e3af-9e14-4342-aa9a-9c3f48d7832a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.177225 Sep 28 08:39:02.532163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 59/123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:02 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:03.375894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:03.376519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:03.383462 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.385198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.386012 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:03.388358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.390270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.391917 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:03.408569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:03.410072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:03.425306 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.425817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.427057 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:03.430019 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.430505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.430958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:03.449612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:03.490637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:03.707179 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:03.720346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0a079184-7a29-4b25-8dce-b36545fbc963 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.348063 Sep 28 08:39:03.720937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 65/124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:03 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:03.730713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:03.735957 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:03.740736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:03.762646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bf17cf31-2c21-48ee-989a-e2a950206ad7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.358718 Sep 28 08:39:03.778443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.781463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 60/125] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:03 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:03.784087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.784555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:03.785806 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.793223 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:03.794069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.794736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:03.796701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:03.808989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.809673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.810262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:03.811314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:03.812634 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:03.813395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:04.004863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:04.017920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-38234fcb-bdd2-4109-b1e2-a4f3aa126ee8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1299 microversion: 2.1 time: 0.293172 Sep 28 08:39:04.018700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 66/126] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:03 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:04.207411 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:04.217321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8993d010-8fe8-4227-b08d-749314e2f4d5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.434289 Sep 28 08:39:04.221710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 61/127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:03 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:04.746893 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:04.747573 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:04.754972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:04.755679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:04.756120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:04.756951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:04.757505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:04.757930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:04.789126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:04.790897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:04.797800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:04.798369 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:04.798998 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:04.799756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:04.800294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:04.800802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:05.001506 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:05.013909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-af0c0e07-4f71-4b77-aa77-3c666a802a78 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.271515 Sep 28 08:39:05.014696 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 67/128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:04 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:05.030049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:05.038523 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-aec272ed-1fad-4462-af3f-aa729e286398 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.253689 Sep 28 08:39:05.053692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 62/129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:04 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:05.056302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:05.056947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:05.063354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:05.063833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:05.064262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:05.064947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:05.065418 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:05.065836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:05.223065 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:05.230809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8745450b-8412-4bcc-87ce-0034da576757 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.178950 Sep 28 08:39:05.231399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 68/130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:05 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:05.244058 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:05.244895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:05.252639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:05.253160 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:05.254023 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:05.254839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:05.255382 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:05.255815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:05.428418 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:05.436844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3e2eda82-56f7-45a3-b6f9-f7c484627e0c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.196751 Sep 28 08:39:05.437810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 63/131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:05 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:06.039146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:06.040014 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:06.046489 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.046940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.047372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.048053 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.048505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.048925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.064012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:06.064781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:06.071497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.071923 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.072437 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.073277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.073806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.074307 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.247112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:06.255654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f2587d3e-cd25-4007-9852-7c2e77e91750 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.220397 Sep 28 08:39:06.269133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 69/132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:06 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:06.269762 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:06.269871 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:06.269871 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:06.275033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2d389f27-6807-4b0d-836c-a3ff139b5bf5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.215777 Sep 28 08:39:06.275595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 64/133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:06 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:06.279016 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.279313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.279751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.281253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.281715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.282137 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.428825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:06.446510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9a48b59a-6dbb-4f66-a7f0-b099b5278ad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.186661 Sep 28 08:39:06.449275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 70/134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:06 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:06.470268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:06.470976 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:06.478033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.478631 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.479408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.480269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.480825 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.481388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.680749 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:06.689992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6181ca09-60b1-40b1-9640-259f204d5fa5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.228181 Sep 28 08:39:06.694370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 65/135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:06 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:06.949281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-f08173dd-8fbc-42da-9905-1c6b2bd19089 req-1830fdf5-c526-4c19-b806-8e09036e7f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d33c275-10df-4eb8-90a9-e31c4a6f9cb6", "name": "network-vif-plugged", "status": "completed", "tag": "d4344f22-bad7-4ad7-8549-d8b5a9bbb4e5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:06.960608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-f08173dd-8fbc-42da-9905-1c6b2bd19089 req-1830fdf5-c526-4c19-b806-8e09036e7f70 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:06.961534 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-f08173dd-8fbc-42da-9905-1c6b2bd19089 req-1830fdf5-c526-4c19-b806-8e09036e7f70 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:06.962062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-f08173dd-8fbc-42da-9905-1c6b2bd19089 req-1830fdf5-c526-4c19-b806-8e09036e7f70 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:06.976576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-f08173dd-8fbc-42da-9905-1c6b2bd19089 req-1830fdf5-c526-4c19-b806-8e09036e7f70 service nova] Creating event network-vif-plugged:d4344f22-bad7-4ad7-8549-d8b5a9bbb4e5 for instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 on hv-cinder-84456 Sep 28 08:39:06.981751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-f08173dd-8fbc-42da-9905-1c6b2bd19089 req-1830fdf5-c526-4c19-b806-8e09036e7f70 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089328 Sep 28 08:39:06.982350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 71/136] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:39:07.281501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:07.283007 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:07.290793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.291837 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.292276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:07.292983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.293657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.299506 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:07.300214 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:07.303593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:07.310276 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.310777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.311227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:07.313863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.318351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.318903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:07.798567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:07.806442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1050cfbd-2abe-42c1-80a0-efe4ffeffdae tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.511256 Sep 28 08:39:07.807028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 72/137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:07 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:07.823246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:07.828737 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:07.832277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:07.842194 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9ad37e9f-894b-4d99-b291-cd4cf685fce3 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.566138 Sep 28 08:39:07.845236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 66/138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:07 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:07.851532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.852032 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.852472 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:07.853362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.853738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.854124 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:07.859054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:07.859792 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:07.872176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.872682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.873155 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:07.874407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:07.881198 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:07.881910 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:08.435827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:08.458180 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7dc3734e-ee03-47e6-96fe-6ce963a36800 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.649550 Sep 28 08:39:08.459293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 73/139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:07 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:08.482820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:08.494540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7ae4a246-8e98-47cb-943e-695b7e3320d3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.647421 Sep 28 08:39:08.495554 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 67/140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:07 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:08.684556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-81b8be8b-5f40-47b8-bf32-8efbd745e328 req-358e2958-171c-4092-8c31-3e6af91e5557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d333fe6-3d16-47c6-9104-714c67456652", "tag": "3e899002-2d72-495c-ac21-1db3e1f0ae42"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:08.697039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81b8be8b-5f40-47b8-bf32-8efbd745e328 req-358e2958-171c-4092-8c31-3e6af91e5557 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:08.698454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81b8be8b-5f40-47b8-bf32-8efbd745e328 req-358e2958-171c-4092-8c31-3e6af91e5557 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:08.699099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81b8be8b-5f40-47b8-bf32-8efbd745e328 req-358e2958-171c-4092-8c31-3e6af91e5557 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:08.714726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-81b8be8b-5f40-47b8-bf32-8efbd745e328 req-358e2958-171c-4092-8c31-3e6af91e5557 service nova] Creating event network-changed:3e899002-2d72-495c-ac21-1db3e1f0ae42 for instance 1d333fe6-3d16-47c6-9104-714c67456652 on hv-cinder-84456 Sep 28 08:39:08.723310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-81b8be8b-5f40-47b8-bf32-8efbd745e328 req-358e2958-171c-4092-8c31-3e6af91e5557 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041525 Sep 28 08:39:08.724524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 74/141] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:39:08.831952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:08.832637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:08.848740 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:08.849542 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:08.850191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:08.851386 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:08.852430 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:08.852860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:08.872136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:08.872845 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:08.880204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:08.880698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:08.881171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:08.881881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:08.882335 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:08.882758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:09.071099 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:09.087161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d3d7b090-aaf0-491c-ada3-7c5d52be72c3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.258935 Sep 28 08:39:09.087734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 68/142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:08 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:09.095725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:09.105251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-84154608-7269-4fb7-b6c8-f34f86f343b2 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.237390 Sep 28 08:39:09.105821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 75/143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:08 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:09.482274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:09.482880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:09.489711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:09.490198 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:09.490624 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:09.491304 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:09.491748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:09.492160 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:09.518414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:09.519039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:09.537362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:09.538756 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:09.539835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:09.540770 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:09.541463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:09.541891 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:09.693392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:09.701144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7e85fc3c-3689-4487-b82c-14e25c0154c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.222613 Sep 28 08:39:09.701712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 69/144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:09 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:09.726842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:09.736734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fdd2802e-161e-42f9-9718-00150fcd9045 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.222061 Sep 28 08:39:09.737351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 76/145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:09 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:10.111743 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:10.112429 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:10.119021 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.119523 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.119962 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.120666 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.121159 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.121579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.131056 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:10.132559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:10.141438 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.142045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.142551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.143337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.143861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.144362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.319758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:10.330191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5deacab8-792c-4aaa-a6a8-797a39ee8e9b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.221949 Sep 28 08:39:10.331102 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 70/146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:10 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:10.345043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:10.353024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d2d1b392-8816-4e6f-be7a-ed0ddd48c19e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.227070 Sep 28 08:39:10.353605 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 77/147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:10 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:10.727932 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:10.728785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:10.736089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.736715 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.737405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.738096 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.738835 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.739235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.760216 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:10.760995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:10.767325 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.767817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.768246 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.768935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:10.773594 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:10.774037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:10.964199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:10.972237 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:10.973688 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e9476fe6-825b-4779-94d8-4c2530e7a093 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.249513 Sep 28 08:39:10.977683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 71/148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:10 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:10.980467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-971e646c-055a-406e-a910-fe1aaa1fc317 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.223998 Sep 28 08:39:10.981118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 78/149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:10 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:11.353361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:11.354063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:11.360734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:11.361423 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:11.362107 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:11.363135 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:11.363673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:11.364188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:11.378768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:11.379453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:11.385515 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:11.386008 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:11.386445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:11.387192 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:11.387891 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:11.388428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:11.564235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:11.571109 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:11.571964 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fdaa1872-6e87-4cef-8c9e-1f7846a41689 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.222538 Sep 28 08:39:11.572548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 72/150] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:11 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:11.579551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5f611e5f-c56c-48d0-9320-bf69ed5ffb74 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.206394 Sep 28 08:39:11.580122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 79/151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:11 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:12.003281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:12.003906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:12.004270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:12.004354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:12.009830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.010188 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.010302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.010675 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.010791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.011106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.011424 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.011794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.011883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.012245 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.012336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.012671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.212755 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:12.217400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:12.221459 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a99ad2ee-c2d0-4a52-ab5c-064011fb1799 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.222922 Sep 28 08:39:12.221754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 73/152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:11 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:12.225788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-85ed7167-a0f3-4814-b9c1-6a2f04a48aa8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.225780 Sep 28 08:39:12.226348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 80/153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:11 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:12.598669 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:12.599198 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:12.602405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:12.603097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:12.605216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.605702 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.606137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.606833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.607284 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.607706 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.609118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.609618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.610080 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.610748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:12.611204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:12.611636 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:12.809815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:12.815191 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:12.818418 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-549498a8-8607-4849-9ba3-053bc5567830 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.227271 Sep 28 08:39:12.824029 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bf551f65-1c36-45ad-9415-6a22494dd387 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.225526 Sep 28 08:39:12.824868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 81/154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:12 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:12.834102 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 74/155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:12 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:13.244813 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:13.245447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:13.247358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:13.249703 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:13.250322 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:13.253265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.253751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.254178 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.254866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.255310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.255723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.256245 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.256738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.257192 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.257880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.258338 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.258759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.447954 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:13.452167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:13.455718 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-600f2631-298e-456c-ad5a-19484bb64708 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.214822 Sep 28 08:39:13.456291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 82/156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:13 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:13.460037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8af1f794-1a0c-44c3-b09e-2f608599bc06 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.215068 Sep 28 08:39:13.460846 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 75/157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:13 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:13.843459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:13.844175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:13.848141 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:13.848749 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:13.850433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.850925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.851351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.851585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=94 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:13.852208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.852706 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.853289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.856716 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.857238 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.857679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.859035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:13.859494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:13.859916 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:13.869934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:14.052841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:14.056766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:14.060626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-44a6db86-cc2e-44ba-86d6-581ac5c141b5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.221832 Sep 28 08:39:14.061286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 83/158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:13 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:14.064399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-61e6ebe6-5a5f-48a3-8d8f-692449d45782 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.220009 Sep 28 08:39:14.064951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 76/159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:13 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:14.478735 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:14.479352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:14.482900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:14.483636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:14.486288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:14.486779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:14.487215 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:14.487913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:14.488361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:14.488967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:14.489632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:14.490261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:14.490702 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:14.491403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:14.491859 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:14.492285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:14.497061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:14.687182 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:14.694567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:14.695176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d525e25f-b2a1-41c9-b910-91ddcf151e19 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.216366 Sep 28 08:39:14.695747 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 77/160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:14 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:14.703016 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c1a5654d-cc94-439c-9a51-f8b67129844f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.228009 Sep 28 08:39:14.703650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 84/161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:14 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:15.083195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:15.083841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:15.086986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:15.087598 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:15.089752 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.090246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.090692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.091387 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.091844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.092273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.094260 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.094740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.095179 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.095857 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.096308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.096726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.285157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:15.288652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:15.293244 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7635610c-9f9e-4fab-b3cd-dd79be75c560 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.213963 Sep 28 08:39:15.293807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 78/162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:15 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:15.297038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-35c9e721-0204-45dc-9c7f-28989530d2d5 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.213826 Sep 28 08:39:15.297616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 85/163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:15 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:15.719105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:15.719804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:15.724539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:15.725169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:15.726073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.726566 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.727005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.727703 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.728151 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.728581 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.731366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.731850 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.732275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.732961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:15.733437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:15.733860 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:15.927952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:15.931116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:15.935614 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-385940c7-531e-4e06-9974-d101efcf876b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.221008 Sep 28 08:39:15.936367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 79/164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:15 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:15.939128 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8975651d-04fb-4c1a-a91f-9be7afb9ec7a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.218302 Sep 28 08:39:15.939689 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 86/165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:15 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:16.315724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:16.316328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:16.319067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:16.319685 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:16.322492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.323004 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.323491 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:16.324199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.324828 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.325282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:16.325617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.326103 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.326539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:16.327720 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.328178 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.328601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:16.525810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:16.530535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:16.533792 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8a6bd27a-ac74-4a20-859c-a36ff72a8b26 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.221840 Sep 28 08:39:16.534370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 80/166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:16 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:16.538035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a9d2814a-b91c-46f3-b0c6-816791a66e2f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.222756 Sep 28 08:39:16.538580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 87/167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:16 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:16.959012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:16.959626 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:16.961004 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:16.961639 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:16.965826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.966375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.966742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:16.967489 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.968276 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.968481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.968796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.968904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:16.969270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:16.969970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:16.970546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:16.970978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:17.163484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:17.178536 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4b017e83-8fe5-43c7-858a-c4c5b41ca779 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.221033 Sep 28 08:39:17.179225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 88/168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:16 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:17.180673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:17.189343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4dd878ff-c03f-4416-be54-67a8b6ffa68d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.234133 Sep 28 08:39:17.197408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 81/169] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:16 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:17.557670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:17.558163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:17.562136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:17.562756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:17.566682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:17.567253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:17.567694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:17.568387 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:17.568868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:17.569239 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:17.569342 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:17.569823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:17.570328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:17.571099 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:17.571636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:17.572262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:17.790912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:17.794521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:17.803193 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-349e28ff-4c95-4aaf-b742-6cddc6c07412 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.245791 Sep 28 08:39:17.803761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 82/170] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:17 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:17.806539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ab6f391a-bb84-4a13-b795-483095564ae8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.252766 Sep 28 08:39:17.807104 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 89/171] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:17 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:18.202809 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:18.204086 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:18.210516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.211248 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.211843 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.212701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.213588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.214763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.218187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:18.218784 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:18.237018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.237781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.238242 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.239456 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.240205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.240205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.696929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:18.706379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:18.709946 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fa577c2f-1cae-48c1-be6e-510ae0c6fd45 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.511204 Sep 28 08:39:18.711074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 83/172] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:18 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:18.718898 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-1256548f-8084-4702-bde8-d6f18486adca req-a3e4262e-4b56-4360-9db9-4faa5465f8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58d7457-5855-4349-876d-c208e237594e", "name": "network-vif-plugged", "status": "completed", "tag": "6a3b0562-aa67-4f66-a0ad-66e753e42296"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:18.731296 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-eb318155-f770-4209-a736-176f44ae228b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.519155 Sep 28 08:39:18.731881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 90/173] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:18 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:18.739483 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-1256548f-8084-4702-bde8-d6f18486adca req-a3e4262e-4b56-4360-9db9-4faa5465f8a2 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.740291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-1256548f-8084-4702-bde8-d6f18486adca req-a3e4262e-4b56-4360-9db9-4faa5465f8a2 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.740936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-1256548f-8084-4702-bde8-d6f18486adca req-a3e4262e-4b56-4360-9db9-4faa5465f8a2 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.755337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-1256548f-8084-4702-bde8-d6f18486adca req-a3e4262e-4b56-4360-9db9-4faa5465f8a2 service nova] Creating event network-vif-plugged:6a3b0562-aa67-4f66-a0ad-66e753e42296 for instance d58d7457-5855-4349-876d-c208e237594e on hv-cinder-84456 Sep 28 08:39:18.761914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-1256548f-8084-4702-bde8-d6f18486adca req-a3e4262e-4b56-4360-9db9-4faa5465f8a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048371 Sep 28 08:39:18.762529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 84/174] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:39:18.828915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:18.829730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:18.830117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:18.831021 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:18.837409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.837894 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.838395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.838953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.839101 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.839458 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.839636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.840348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.840482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:18.840708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:18.841303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:18.841868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:19.051309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:19.059005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:19.060361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e734af3f-519e-4b90-bbd5-71a8a618a5fd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.235159 Sep 28 08:39:19.060936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 85/175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:18 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:19.067448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-af32d209-66ed-4c05-b4a8-b228938d2781 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.243934 Sep 28 08:39:19.067980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 91/176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:18 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:19.740305 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:19.741718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:19.756707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:19.757502 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:19.763591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:19.767245 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:19.768862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:19.770802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:19.771513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:19.773492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:19.774091 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:19.775732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:19.777920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:19.779204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:19.779679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:19.783934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:20.138304 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:20.147610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4505c579-c12c-4e4c-ade9-52c10b0d8d93 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.396034 Sep 28 08:39:20.161133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 92/177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:19 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:20.166690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:20.167495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:20.187129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:20.187820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:20.188320 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:20.189697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:20.190446 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:20.191039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:20.383248 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:20.396261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-89eacd4d-f6e0-4f7c-a2b5-2170125072de tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.659070 Sep 28 08:39:20.396465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 86/178] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:19 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:20.414104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:20.415851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:20.437858 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:20.438640 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:20.439241 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:20.440136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:20.440737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:20.441361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:20.615179 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:20.621893 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-092bea6d-23dc-439b-9536-94e5d081a002 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.470496 Sep 28 08:39:20.622561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 93/179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:20 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:20.674110 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:20.682377 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f0788a0d-4d69-41cb-9096-3832d411fadb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.284896 Sep 28 08:39:20.682951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 87/180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:20 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:21.177222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:21.177764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:21.184904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.184904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.185105 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.185900 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.186412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.187078 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.361711 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:21.369597 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6c7b65a0-f5ed-4ba7-8a68-ce8cdfe39eec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.196602 Sep 28 08:39:21.370284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 94/181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:21 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:21.423479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:21.424120 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:21.430208 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.430606 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.431216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.432066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.432725 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.433133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.581526 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:21.589153 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3f075c92-cd46-45b3-b68b-4487bcf3e46b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.169713 Sep 28 08:39:21.589780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 88/182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:21 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:21.645793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:21.646412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:21.653084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.653743 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.654308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.655275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.655794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.656253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.710676 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:21.711280 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:21.720887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.721657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.722312 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.723654 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:21.724585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:21.725272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:21.834810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:21.844425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-299aead3-fdd9-4f1d-928e-74b85dfb4951 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.202383 Sep 28 08:39:21.844998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 95/183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:21 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:21.911965 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:21.920027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2f3924b4-5bf3-4f4d-9347-f0853f62dd1a tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.214184 Sep 28 08:39:21.921336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 89/184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:21 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:22.393715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:22.394335 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:22.401469 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.402260 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.402744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:22.403642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.404289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.405631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:22.568272 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:22.579323 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0ebbc67f-dc33-48ab-98b0-4df9eb2fa438 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.190249 Sep 28 08:39:22.580613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 96/185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:22 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:22.612883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:22.613563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:22.622706 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.623399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.624777 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:22.625661 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.626259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.626868 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:22.785896 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:22.796329 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-42d5f000-981e-49ad-93c4-99e1064503bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.186950 Sep 28 08:39:22.796329 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 90/186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:22 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:22.867269 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:22.867929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:22.875345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.875820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.876471 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:22.877230 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.877688 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.878268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:22.944124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:22.944881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:22.951355 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.952742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.953454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:22.954271 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:22.954828 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:22.955441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:23.074210 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:23.083341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c212134c-37bc-4c36-9d5b-5c1d7fbaefea tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.219429 Sep 28 08:39:23.083341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 97/187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:22 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:23.148659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:23.158184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-eb927698-f962-4181-8be0-45c4343ea07b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.218076 Sep 28 08:39:23.159371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 91/188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:22 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:23.270358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-edbe6e0d-ee56-4add-8572-35ee1e8caec0 req-8ec44bf2-9988-4e66-bb82-ca7cb7414171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53562009-e64b-47ed-8dd7-890647fe3e44", "name": "network-vif-plugged", "status": "completed", "tag": "f6ac07f3-2675-41dc-968c-7b86388bb047"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:23.280189 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-edbe6e0d-ee56-4add-8572-35ee1e8caec0 req-8ec44bf2-9988-4e66-bb82-ca7cb7414171 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:23.280756 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-edbe6e0d-ee56-4add-8572-35ee1e8caec0 req-8ec44bf2-9988-4e66-bb82-ca7cb7414171 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:23.281443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-edbe6e0d-ee56-4add-8572-35ee1e8caec0 req-8ec44bf2-9988-4e66-bb82-ca7cb7414171 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:23.299737 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-edbe6e0d-ee56-4add-8572-35ee1e8caec0 req-8ec44bf2-9988-4e66-bb82-ca7cb7414171 service nova] Creating event network-vif-plugged:f6ac07f3-2675-41dc-968c-7b86388bb047 for instance 53562009-e64b-47ed-8dd7-890647fe3e44 on hv-cinder-84456 Sep 28 08:39:23.309361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-edbe6e0d-ee56-4add-8572-35ee1e8caec0 req-8ec44bf2-9988-4e66-bb82-ca7cb7414171 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038236 Sep 28 08:39:23.310477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 98/189] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:39:23.606450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:23.607067 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:23.615217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:23.616159 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:23.616596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:23.617297 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:23.619645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:23.621151 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:23.818888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:23.819614 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:23.820317 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:23.828938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:23.829385 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:23.829816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:23.829992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-adc79fd0-df94-4bcf-b457-0a6d0cdf5518 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.227254 Sep 28 08:39:23.830658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:23.831108 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:23.831352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 92/190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:23 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:23.831899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:24.024595 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:24.033824 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-137c7736-0536-430c-bba0-f1672ce67a7b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.219139 Sep 28 08:39:24.034553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 99/191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:23 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:24.106678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:24.107571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:24.113784 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:24.114357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:24.114795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:24.115683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:24.116326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:24.116914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:24.183508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:24.186694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:24.197067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:24.197949 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:24.198739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:24.199886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:24.200487 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:24.201042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:24.296489 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:24.306082 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-087d1830-9a0d-47e4-b966-a39d9f0c8e98 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.203212 Sep 28 08:39:24.306686 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 93/192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:24 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:24.372846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:24.375690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:24.383250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d7a5aad9-f65d-49c9-b18e-722215338896 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1314 microversion: 2.1 time: 0.205175 Sep 28 08:39:24.383837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 100/193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:24 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:24.856837 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:24.858580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:24.869043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:24.869558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:24.870117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:24.870674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:24.871123 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:24.871544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:24.909416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:25.052552 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:25.060577 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:25.061291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:25.061870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-44925519-4966-4022-a87c-23ddefbe1228 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.211033 Sep 28 08:39:25.062458 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 94/194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:24 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:25.074231 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:25.075139 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:25.076048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:25.077959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:25.078434 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:25.080362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:25.240256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:25.248023 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e340216f-9ecd-4f47-b2dc-16feb6e11ed6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.194237 Sep 28 08:39:25.248832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 101/195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:25 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:25.331526 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:25.333183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:25.340361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:25.341054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:25.341753 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:25.343370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:25.343992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:25.344724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:25.406436 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:25.407536 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:25.415108 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:25.416680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:25.417922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:25.418793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:25.419429 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:25.420158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:25.656583 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:25.666048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3e2cb1de-f88f-41be-8fd0-6b3d6c8d1616 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.339739 Sep 28 08:39:25.666519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 95/196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:25 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:25.672247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:25.688217 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2e76de0c-0dec-4920-83d9-b59ed1c6e23c tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1500 microversion: 2.1 time: 0.285682 Sep 28 08:39:25.692339 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 102/197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:25 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1500 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:26.086499 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:26.087122 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:26.095560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:26.097579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:26.104008 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:26.105921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:26.106409 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:26.117476 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:26.271647 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:26.272249 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:26.282960 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:26.283409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:26.283899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:26.286092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:26.286564 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:26.286995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:26.307389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:26.316189 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0080f6ab-6def-4db4-b422-3246aa83acec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1322 microversion: 2.1 time: 0.233842 Sep 28 08:39:26.317149 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 96/198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:26 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:26.460421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:26.469284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-184213ea-7687-4b4a-b4a0-97c729c8c941 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.201534 Sep 28 08:39:26.469859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 103/199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:26 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:26.692375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:26.693229 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:26.699595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:26.700274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:26.700911 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:26.701683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:26.702788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:26.703302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:26.852250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:26.863001 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7ba9125a-96e9-4f61-9ab3-ab33d51cb162 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.174977 Sep 28 08:39:26.863576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 97/200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:26 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:27.340144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:27.340906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:27.350138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.350643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.351236 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.353111 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.354348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.355261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.492126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:27.492737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:27.498457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.499143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:27.499288 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.499710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.500565 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.501209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.501783 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.509298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-45a7567c-7f68-43ab-a5b1-52726b16c172 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1516 microversion: 2.1 time: 0.173117 Sep 28 08:39:27.509873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 104/201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:27 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:27.535231 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:27.537632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:27.544493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.545133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.545680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.546436 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.546951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.547435 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.611744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'flavor' on Instance uuid d58d7457-5855-4349-876d-c208e237594e {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:39:27.655632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:27.665382 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4d350eb3-0809-4d98-92aa-5ab6a340b775 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.176871 Sep 28 08:39:27.666536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 98/202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:27 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:27.745693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-73298d09-a89b-45b6-9580-7abcd6e25075 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e/action" status: 200 len: 32 microversion: 2.1 time: 0.215586 Sep 28 08:39:27.746761 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 105/203] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:39:27 2022] POST /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:39:27.756346 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:27.756958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:27.762888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.763325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.763761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.764984 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.765478 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.765901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.888661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:27.889665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:27.902754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.903428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.903872 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.905989 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:27.906454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:27.908888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:27.918817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:27.931576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4b1d4470-1ea5-47c9-9c5b-16ead44ef04a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.179469 Sep 28 08:39:27.932051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 99/204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:27 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:28.076834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:28.085201 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-35960410-4845-4433-af21-f436199759c1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.202343 Sep 28 08:39:28.085791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 106/205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:27 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:28.302360 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28018027-e212-4076-84d3-03950e2013db"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:28.304962 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:28.310820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:28.312049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:28.312548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:28.313328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:28.313854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:28.314383 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:28.664962 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-0caf5bf1-bfbc-4ce8-adbc-f54616d25b3f req-72623e22-df27-4f55-8151-5eab58c51aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf04325-2791-450a-8f0c-7ab39f891ec4", "name": "network-vif-plugged", "status": "completed", "tag": "c6a4b931-a59a-4621-8e16-7c3e343a1e8a"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:28.675963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0caf5bf1-bfbc-4ce8-adbc-f54616d25b3f req-72623e22-df27-4f55-8151-5eab58c51aa2 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:28.676485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0caf5bf1-bfbc-4ce8-adbc-f54616d25b3f req-72623e22-df27-4f55-8151-5eab58c51aa2 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:28.676911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0caf5bf1-bfbc-4ce8-adbc-f54616d25b3f req-72623e22-df27-4f55-8151-5eab58c51aa2 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:28.688418 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-0caf5bf1-bfbc-4ce8-adbc-f54616d25b3f req-72623e22-df27-4f55-8151-5eab58c51aa2 service nova] Creating event network-vif-plugged:c6a4b931-a59a-4621-8e16-7c3e343a1e8a for instance bdf04325-2791-450a-8f0c-7ab39f891ec4 on hv-cinder-84456 Sep 28 08:39:28.693877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-0caf5bf1-bfbc-4ce8-adbc-f54616d25b3f req-72623e22-df27-4f55-8151-5eab58c51aa2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 Sep 28 08:39:28.694465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 107/206] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:39:28.699352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:28.700121 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:28.706122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:28.706602 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:28.707031 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:28.707714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:28.708161 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:28.708576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:28.847847 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:28.855366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f7db5776-b520-4e73-9672-4c51215d77d3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.159828 Sep 28 08:39:28.855917 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 108/207] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:28 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:28.955793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:28.956428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:28.962344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:28.962827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:28.963261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:28.963950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:28.964403 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:28.964826 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:29.094134 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:29.101756 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-282806c0-75bf-4643-abc5-54cf37d83efe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.150181 Sep 28 08:39:29.102312 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 109/208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:28 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:29.109503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:29.110112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:29.115984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:29.116452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:29.116885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:29.117608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:29.118062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:29.118487 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:29.244686 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:29.252939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8d578a3d-971d-44b8-b0d3-23bafc3e9dc2 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.146985 Sep 28 08:39:29.253478 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 110/209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:29 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:29.879405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:29.880044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:29.885944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:29.886418 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:29.886849 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:29.887521 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:29.887965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:29.888378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:30.018650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:30.026357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a1b249dc-2f2a-49f9-9dfa-00c2a9c6c219 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.150743 Sep 28 08:39:30.026928 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 111/210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:29 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:30.123728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:30.124250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:30.130065 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:30.130578 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:30.130999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:30.131670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:30.132115 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:30.132532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:30.259099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:30.266668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bba6b91a-1b7a-43f9-b99b-6b7be171b370 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.146888 Sep 28 08:39:30.267243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 112/211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:30 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:30.275346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:30.275955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:30.282122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:30.282609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:30.283043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:30.283733 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:30.284188 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:30.284610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:30.418281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:30.426610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-055779fe-d10f-49b4-83b0-fe7ba1c11b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.154855 Sep 28 08:39:30.427212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 113/212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:30 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:31.049362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:31.050001 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:31.056195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:31.056762 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:31.057118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:31.057825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:31.058275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:31.058694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:31.188453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:31.196481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b6439c19-78f8-4113-862a-2b075637f021 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.150964 Sep 28 08:39:31.197128 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 114/213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:31 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:31.290854 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:31.291453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:31.298021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:31.298499 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:31.298937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:31.299617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:31.300062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:31.300479 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:31.428116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:31.435787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bd2162e0-39bf-47b2-a848-99f363da5754 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.149621 Sep 28 08:39:31.436958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 115/214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:31 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:31.449692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:31.450372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:31.457203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:31.457669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:31.458095 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:31.458771 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:31.459216 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:31.459631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:31.463625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:31.587604 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:31.595929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6f5447b9-2ccf-496e-bce0-b2f07f78bf31 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.149794 Sep 28 08:39:31.596671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 116/215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:31 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:32.222608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:32.224002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:32.229991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:32.230471 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:32.230904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:32.231605 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:32.232046 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:32.232497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:32.359054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:32.366692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c5f1d74e-87ec-45d4-ba6c-fd79b26a5e62 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.147950 Sep 28 08:39:32.367253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 117/216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:32 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:32.459247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:32.459914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:32.465761 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:32.466228 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:32.466666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:32.467357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:32.467808 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:32.468238 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:32.598451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:32.606000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5e2d36b7-535a-479a-8701-e74fce676300 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.150537 Sep 28 08:39:32.606550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 118/217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:32 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:32.619241 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:32.619849 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:32.626243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:32.626736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:32.627173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:32.627881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:32.628337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:32.628912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:32.755027 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:32.762568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-36addea7-955d-406d-a679-72e80cb1f765 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.147123 Sep 28 08:39:32.763131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 119/218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:32 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:33.390601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:33.391211 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:33.397507 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:33.397998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:33.398432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:33.399136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:33.399670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:33.400118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:33.558906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:33.566836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-adf5833e-17e3-4a3f-8d60-ae2759459a91 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.180242 Sep 28 08:39:33.567427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 120/219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:33 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:33.633229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:33.633903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:33.641026 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:33.641551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:33.641983 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:33.642667 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:33.643114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:33.643532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:33.788436 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:33.796794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8cd5334e-136d-4fb9-bff0-60a6e7b5633e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.168686 Sep 28 08:39:33.797381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 121/220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:33 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:33.801747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:33.802345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:33.807984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:33.808459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:33.808886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:33.809612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:33.810063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:33.810493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:33.948968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:33.956858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-35b7fcdc-0501-411b-af3a-71c36e2cf608 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.158523 Sep 28 08:39:33.957443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 122/221] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:33 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:34.591072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:34.591712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:34.598283 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:34.598727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:34.599163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:34.599864 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:34.600316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:34.600740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:34.742335 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:34.750399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a43c7797-284e-494c-8f1d-0f2a938782c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.163222 Sep 28 08:39:34.750950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 123/222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:34 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:34.823223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:34.823758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:34.830287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:34.830769 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:34.831198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:34.831888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:34.832338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:34.832759 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:34.969272 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:34.977253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f8f8a55c-8082-4bc1-89f4-1c811d074867 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.157946 Sep 28 08:39:34.977815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 124/223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:34 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:34.982281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:34.983412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:34.988972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:34.989484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:34.989955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:34.990614 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:34.991061 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:34.991558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:35.121923 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:35.130187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3038ed08-6a71-433f-9c6e-10e97284110b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.151405 Sep 28 08:39:35.130751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 125/224] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:34 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:35.775103 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:35.775724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:35.782520 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:35.782941 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:35.783368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:35.784052 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:35.784496 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:35.784917 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:35.933553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:35.943219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-76d8b043-27a6-49cc-b648-cd19ddbed622 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.173507 Sep 28 08:39:35.943777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 126/225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:35 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:36.002815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:36.003430 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:36.009759 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:36.010252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:36.010754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:36.011385 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:36.011842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:36.012266 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:36.147135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:36.153330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d1dc5d3f-f7c8-4373-88e5-8146fc5d0e2b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.155169 Sep 28 08:39:36.153898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 127/226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:35 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:36.158426 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:36.159272 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:36.167172 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:36.167661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:36.168104 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:36.168802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:36.169286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:36.169715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:36.306510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:36.314465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-41c48399-b052-41b8-8563-d3630108ac6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.159575 Sep 28 08:39:36.315049 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 128/227] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:36 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:36.968035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:36.977877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:37.024859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:37.025384 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:37.025849 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:37.026561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:37.027005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:37.027425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:37.220318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:37.230436 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-34f27924-b2eb-4ffb-b110-97a02235cf19 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.266242 Sep 28 08:39:37.231563 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 129/228] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:36 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:37.238366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:37.239383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:37.245613 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7904dc11-d93c-4ac6-be47-8f43056603af tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "POST /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.947408 Sep 28 08:39:37.250995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:37.252220 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:37.252836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:37.253902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 100/229] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:39:28 2022] POST /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6/os-volume_attachments => generated 194 bytes in 8956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:39:37.254413 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:37.254955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:37.255946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:37.342809 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:37.344266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:37.350987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:37.351852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:37.352568 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:37.353459 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:37.354150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:37.354985 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:37.440727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:37.451387 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-aeae211b-dfc1-4053-97f3-1e73686444f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.217899 Sep 28 08:39:37.469150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 130/230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:37 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:37.635780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:37.646069 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-69bfe937-e6e2-4d09-83d1-d5567a71cecd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.310680 Sep 28 08:39:37.646763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 101/231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:37 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:38.257098 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:38.257735 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:38.264624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:38.265255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:38.265775 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:38.266494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:38.266951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:38.267368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:38.299422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-bc647497-7354-4d09-a31f-c70f9db538e9 req-82e309a3-7140-472c-88fd-7e71727e095f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d333fe6-3d16-47c6-9104-714c67456652", "name": "network-vif-plugged", "status": "completed", "tag": "3e899002-2d72-495c-ac21-1db3e1f0ae42"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:38.309590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-bc647497-7354-4d09-a31f-c70f9db538e9 req-82e309a3-7140-472c-88fd-7e71727e095f service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:38.310070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-bc647497-7354-4d09-a31f-c70f9db538e9 req-82e309a3-7140-472c-88fd-7e71727e095f service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:38.310496 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-bc647497-7354-4d09-a31f-c70f9db538e9 req-82e309a3-7140-472c-88fd-7e71727e095f service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:38.324150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-bc647497-7354-4d09-a31f-c70f9db538e9 req-82e309a3-7140-472c-88fd-7e71727e095f service nova] Creating event network-vif-plugged:3e899002-2d72-495c-ac21-1db3e1f0ae42 for instance 1d333fe6-3d16-47c6-9104-714c67456652 on hv-cinder-84456 Sep 28 08:39:38.329012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-bc647497-7354-4d09-a31f-c70f9db538e9 req-82e309a3-7140-472c-88fd-7e71727e095f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Sep 28 08:39:38.329832 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 102/232] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:39:38.405039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:38.413251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6c926c58-c369-4ce8-bf37-0e66a0ec269a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.160010 Sep 28 08:39:38.413811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 131/233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:38 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:38.486733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:38.487420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:38.493427 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:38.493902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:38.494331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:38.495010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:38.495457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:38.495876 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:38.629495 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:38.637359 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c1ec431a-5733-4e6a-a935-63b7d594c797 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.155483 Sep 28 08:39:38.637927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 103/234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:38 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:38.675876 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:38.676555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:38.682687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:38.685664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:38.686159 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:38.686589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:38.687294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:38.687736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:38.688319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:38.840820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:38.849917 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:38.852698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2114e6e6-0df7-4c10-8162-5dbc6b407ed4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.181889 Sep 28 08:39:38.861127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 132/235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:38 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:39.437703 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:39.439457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:39.446774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:39.447279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:39.447722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:39.448425 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:39.448883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:39.449933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:39.587957 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:39.595709 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8029f694-c341-4e7a-b2fb-34195911193b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.161875 Sep 28 08:39:39.596281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 104/236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:39 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:39.661711 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:39.662316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:39.668649 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:39.669177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:39.669616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:39.670311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:39.670766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:39.671204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:39.817343 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:39.825968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ef1637ff-33f2-4a83-925b-ca577cd2a9ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.168523 Sep 28 08:39:39.826750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 133/237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:39 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:39.879639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:39.880247 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:39.886258 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:39.886749 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:39.887183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:39.887876 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:39.888330 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:39.888785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:40.043608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:40.052999 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-80185831-a604-4868-affd-5ece282f2980 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.177520 Sep 28 08:39:40.053906 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 105/238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:39 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:40.618403 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:40.619000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:40.624995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:40.625534 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:40.625963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:40.626640 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:40.627092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:40.627508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:40.757497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:40.765251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b976a037-7d54-4ab9-a5b2-19478812b5b8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.150684 Sep 28 08:39:40.765825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 134/239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:40 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:40.853178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:40.853692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:40.860065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:40.860547 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:40.860984 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:40.861822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:40.862333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:40.862758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:40.995938 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:41.005656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b4c0ee9c-6964-460f-9059-f6fb91dafbed tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.157671 Sep 28 08:39:41.006252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 106/240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:40 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:41.077375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:41.078001 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:41.085108 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:41.086032 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:41.087221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:41.088115 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:41.088846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:41.089359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:41.232758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:41.240923 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a098bb2b-14fc-4eca-8206-264932739de1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1362 microversion: 2.1 time: 0.168056 Sep 28 08:39:41.241505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 135/241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:41 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:41.790761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:41.793275 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:41.799575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:41.800073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:41.800518 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:41.801251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:41.801704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:41.802125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:42.029992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:42.030634 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:42.037367 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:42.038087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:42.038704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:42.039531 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:42.040396 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:42.040994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:42.059585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:42.074507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b239ee9a-dd04-4959-9bfa-8a19d80693ca tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.287920 Sep 28 08:39:42.084016 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 107/242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:41 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:42.264294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:42.264925 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:42.272009 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:42.272509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:42.272962 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:42.273845 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:42.274340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:42.274812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:42.553210 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:42.554618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:42.564066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4a05aa32-0b28-48e5-ae29-d6aee54ef0b3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1548 microversion: 2.1 time: 0.303694 Sep 28 08:39:42.566243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3802c5bb-8059-4f26-87c3-f88265f1e3e6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.540307 Sep 28 08:39:42.567092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 108/243] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:42 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1548 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:42.569997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 136/244] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:42 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:42.603184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:42.604980 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:42.613719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:42.614692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:42.615472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:42.616951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:42.622229 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:42.624917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:42.759741 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3855be3f-3f0c-41d7-a792-55bdb7bf6bb5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.170327 Sep 28 08:39:42.760323 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 109/245] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:39:42 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:39:43.099543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:43.100155 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:43.109406 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:43.110478 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:43.110913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:43.113889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:43.114361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:43.114794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:43.406428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:43.419945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-83081ff3-b3b8-469f-88d2-6557e385e998 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.323614 Sep 28 08:39:43.421436 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 137/246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:43 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:43.593325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:43.594133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:43.601719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:43.602224 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:43.602677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:43.604010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:43.604628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:43.605298 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:43.824494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:43.829037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:43.837974 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-789fce1d-bef5-495f-be3b-e7e95cfb8e1f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.249059 Sep 28 08:39:43.838700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 110/247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:43 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:44.442927 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:44.443539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:44.455419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:44.456464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:44.457119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:44.458038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:44.458499 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:44.458921 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:44.484732 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-b10a2db9-f856-49e7-9200-21108c2d7493 req-84fb2bf6-5e3f-4249-ac98-2719109409c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdf04325-2791-450a-8f0c-7ab39f891ec4", "tag": "c6a4b931-a59a-4621-8e16-7c3e343a1e8a"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:44.499963 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=70 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:44.503896 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b10a2db9-f856-49e7-9200-21108c2d7493 req-84fb2bf6-5e3f-4249-ac98-2719109409c1 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:44.504666 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b10a2db9-f856-49e7-9200-21108c2d7493 req-84fb2bf6-5e3f-4249-ac98-2719109409c1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:44.505943 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b10a2db9-f856-49e7-9200-21108c2d7493 req-84fb2bf6-5e3f-4249-ac98-2719109409c1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:44.538347 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-b10a2db9-f856-49e7-9200-21108c2d7493 req-84fb2bf6-5e3f-4249-ac98-2719109409c1 service nova] Creating event network-changed:c6a4b931-a59a-4621-8e16-7c3e343a1e8a for instance bdf04325-2791-450a-8f0c-7ab39f891ec4 on hv-cinder-84456 Sep 28 08:39:44.551898 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-b10a2db9-f856-49e7-9200-21108c2d7493 req-84fb2bf6-5e3f-4249-ac98-2719109409c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073061 Sep 28 08:39:44.552935 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 111/248] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:39:44.746999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:44.762448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-02a615a3-78b5-449a-8be0-348a72bf968b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.323191 Sep 28 08:39:44.763477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 138/249] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:44 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:44.875257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:44.881438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:44.902408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:44.903294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:44.903899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:44.904913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:44.905619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:44.906200 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:45.196038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:45.205987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-417b6df9-dd6d-4622-823f-472086b4303a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.342794 Sep 28 08:39:45.206727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 112/250] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:44 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:45.789391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:45.790269 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:45.800990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:45.801504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:45.801938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:45.802637 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:45.803090 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:45.803512 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:45.973321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:45.983884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-edcbd198-e2a8-4c31-b456-2a6be94785fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.198409 Sep 28 08:39:45.984740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 139/251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:45 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:46.238680 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:46.240240 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:46.250369 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:46.251393 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:46.252141 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:46.253125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:46.254439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:46.255253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:46.476409 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:46.494972 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7b87a99c-9e19-493e-85e0-0807c958d563 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.261332 Sep 28 08:39:46.496158 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 113/252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:46 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:47.011171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:47.012158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:47.027901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:47.029593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:47.030236 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:47.032897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:47.033971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:47.034626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:47.215856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:47.225747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8c7da465-f9e8-4130-aee0-07f05c771430 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1366 microversion: 2.1 time: 0.221338 Sep 28 08:39:47.226931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 140/253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:47 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:47.523020 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:47.523756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:47.530380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:47.530875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:47.531313 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:47.532605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:47.533044 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:47.533492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:47.706432 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:47.715936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-986f691f-0713-48b9-bcc9-9d7ee6b47d04 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.196658 Sep 28 08:39:47.716994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 114/254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:47 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:48.255589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:48.256777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:48.264635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:48.265184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:48.265629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:48.266966 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:48.267424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:48.268368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:48.415513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:48.426225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b2abd317-b553-499c-84ff-13a27e45070a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1556 microversion: 2.1 time: 0.175731 Sep 28 08:39:48.426809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 141/255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:48 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:39:48.450699 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:48.451603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:48.458238 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:48.459106 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:48.459934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:48.460857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:48.461636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:48.462268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:48.581376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a4d7d4ef-eb42-4665-81a1-feaaf61f5b8a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135187 Sep 28 08:39:48.590437 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 115/256] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:39:48 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:39:48.740509 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:48.741169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:48.747709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:48.748427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:48.749232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:48.750139 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:48.751325 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:48.751905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:49.016103 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:49.024313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a7bc61b9-e64b-4dfd-8399-9f5a306833df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.287624 Sep 28 08:39:49.025669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 142/257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:48 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:50.049068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:50.050246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:50.058724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:50.059216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:50.059652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:50.061366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:50.061833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:50.062289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:50.231697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-567edcd2-53f6-4599-b9c9-3eeed59bb1f3 req-5c73d237-46b9-4afb-9803-73d78c000464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d333fe6-3d16-47c6-9104-714c67456652", "tag": "3e899002-2d72-495c-ac21-1db3e1f0ae42"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:50.254450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-567edcd2-53f6-4599-b9c9-3eeed59bb1f3 req-5c73d237-46b9-4afb-9803-73d78c000464 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:50.255030 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-567edcd2-53f6-4599-b9c9-3eeed59bb1f3 req-5c73d237-46b9-4afb-9803-73d78c000464 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:50.255355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-567edcd2-53f6-4599-b9c9-3eeed59bb1f3 req-5c73d237-46b9-4afb-9803-73d78c000464 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:50.270149 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:50.280104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-557766b7-f0a1-49fb-a85e-e62b78881c6d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.234253 Sep 28 08:39:50.285013 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 116/258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:50 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:50.285682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-567edcd2-53f6-4599-b9c9-3eeed59bb1f3 req-5c73d237-46b9-4afb-9803-73d78c000464 service nova] Creating event network-changed:3e899002-2d72-495c-ac21-1db3e1f0ae42 for instance 1d333fe6-3d16-47c6-9104-714c67456652 on hv-cinder-84456 Sep 28 08:39:50.292309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-567edcd2-53f6-4599-b9c9-3eeed59bb1f3 req-5c73d237-46b9-4afb-9803-73d78c000464 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067161 Sep 28 08:39:50.294372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 143/259] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:39:51.308358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:51.309181 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:51.316915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:51.317808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:51.318338 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:51.319351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:51.320054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:51.320555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:51.528633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:51.540625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a6e51c28-2e62-4b38-be19-a9e8f4a22210 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.237581 Sep 28 08:39:51.553120 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 117/260] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:51 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:52.566875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:52.567618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:52.574298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:52.574827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:52.575247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:52.575984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:52.576442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:52.576868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:52.727899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:52.735606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6ce368a6-35fd-41af-9498-7e49a493fabe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.174310 Sep 28 08:39:52.736164 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 144/261] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:52 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:53.759350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:53.759982 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:53.766489 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:53.766972 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:53.767413 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:53.768106 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:53.768845 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:53.769307 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:53.900605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:53.908434 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b009e759-258e-4b2d-9e1c-09c4149e916e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.152945 Sep 28 08:39:53.909003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 118/262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:53 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:54.931421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:54.932054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:54.938831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:54.939313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:54.939738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:54.940596 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:54.941222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:54.941782 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:55.101867 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:55.108126 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-88c1da08-85f4-47e2-920d-38e42fb07089 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.180411 Sep 28 08:39:55.108866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 145/263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:54 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:56.136457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:56.137085 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:56.158002 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:56.158720 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:56.159355 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:56.160236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:56.160848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:56.161470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:56.356198 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:56.367991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9f561352-68eb-46d3-842a-e159b6a5d405 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.236991 Sep 28 08:39:56.369126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 119/264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:56 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:56.490029 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:56.490583 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:56.499273 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:56.499946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:56.501068 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:56.502043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:56.502642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:56.503208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:56.540436 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:39:56.643686 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b876c800-0c4e-46bb-809a-24beeac0b9f4 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 204 len: 0 microversion: 2.1 time: 0.158365 Sep 28 08:39:56.644273 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 146/265] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:39:56 2022] DELETE /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:39:56.654448 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:56.655362 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:56.662467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:56.662949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:56.663593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:56.664245 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:56.664849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:56.665701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:56.811724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:56.821136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d839fc26-164c-4128-b548-960bc3d5c8c6 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1552 microversion: 2.1 time: 0.171056 Sep 28 08:39:56.821905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 120/266] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:56 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:57.393557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:57.394255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:57.400167 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:57.400652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:57.401099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:57.401819 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:57.402271 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:57.402694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:57.534390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:57.542744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8be6919f-23e8-461b-9ae2-4a841576748b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.154141 Sep 28 08:39:57.543335 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 147/267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:57 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:57.844280 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:57.845950 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:57.852849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:57.853364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:57.853795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:57.854574 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:57.855256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:57.855677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:57.954717 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-670455878", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:39:58.001405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:58.011735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d12e7cb3-4e61-49bf-844b-7ed6ddc7759e tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1552 microversion: 2.1 time: 0.171536 Sep 28 08:39:58.012636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 121/268] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:57 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:58.037907 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] validate_networks() for None {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:39:58.323373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:39:58.323961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:39:58.324611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:39:58.325207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:39:58.325844 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:39:58.335380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:58.335863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:58.336297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:58.337023 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:58.337505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:58.337931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:58.355113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Getting quotas for project 3777d8561b4e4c9385e87007b37fa57a. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:39:58.359348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Getting quotas for user 5c45623c9421460abfa049a8040c7c12 and project 3777d8561b4e4c9385e87007b37fa57a. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:39:58.372476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:39:58.375817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:39:58.425532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7e0f6acb-2a60-47e3-954c-33b6ada53697 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475513 Sep 28 08:39:58.426658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 148/269] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:39:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 08:39:58.439736 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e86cfb6e-ee94-42d3-b9cd-71679ca2ced5 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:58.448979 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e86cfb6e-ee94-42d3-b9cd-71679ca2ced5 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:58.525393 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e86cfb6e-ee94-42d3-b9cd-71679ca2ced5 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:58.539000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e86cfb6e-ee94-42d3-b9cd-71679ca2ced5 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1214 microversion: 2.1 time: 0.104825 Sep 28 08:39:58.539569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 122/270] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:58 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:58.565367 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:58.566080 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:58.573009 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:58.573606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:58.574112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:58.574877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:58.575408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:58.575894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:58.580556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:39:58.726268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:58.734461 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b4a97d0a-c1e3-4777-a33c-62b2fdbe57da tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.172972 Sep 28 08:39:58.735662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 149/271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:58 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:59.036431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:59.037175 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:59.043121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:59.043600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:59.044028 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:59.045076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:59.045562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:59.045989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:59.234671 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:59.248291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-244d5777-fef8-46c6-8738-4f9fe685b66b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1552 microversion: 2.1 time: 0.216085 Sep 28 08:39:59.258125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 123/272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:59 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:59.566854 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:59.567726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:59.584839 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:59.585873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:59.586796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:59.588234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:59.588974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:59.589812 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:59.717836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:59.732181 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-947f8454-a1da-48fb-940e-f2bb1ac2bbba tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1266 microversion: 2.1 time: 0.172745 Sep 28 08:39:59.732791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 150/273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:59 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:39:59.761637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:39:59.762336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:39:59.775028 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:59.776046 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:59.777602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:59.778356 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:39:59.778832 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:39:59.782703 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:39:59.986677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:39:59.999378 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5b009c33-545b-4691-85bc-be7595ad1fb5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.242345 Sep 28 08:39:59.999711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 124/274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:39:59 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:00.298943 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:00.300117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:00.316187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:00.316187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:00.318458 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:00.320190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:00.321481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:00.322627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:00.601803 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:00.608705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-99543492-db4d-4367-b71b-86610f5ac0c6 req-8704dd52-8db1-4ffe-9a77-a3b05edd4c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d33c275-10df-4eb8-90a9-e31c4a6f9cb6", "name": "network-vif-deleted", "tag": "d4344f22-bad7-4ad7-8549-d8b5a9bbb4e5"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:00.615949 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-93160d90-5228-4394-aea4-bd6988ca071b tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1552 microversion: 2.1 time: 0.324861 Sep 28 08:40:00.616754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 151/275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:00 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1552 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:00.621800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-99543492-db4d-4367-b71b-86610f5ac0c6 req-8704dd52-8db1-4ffe-9a77-a3b05edd4c3c service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:00.622510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-99543492-db4d-4367-b71b-86610f5ac0c6 req-8704dd52-8db1-4ffe-9a77-a3b05edd4c3c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:00.622930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-99543492-db4d-4367-b71b-86610f5ac0c6 req-8704dd52-8db1-4ffe-9a77-a3b05edd4c3c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:00.635021 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-99543492-db4d-4367-b71b-86610f5ac0c6 req-8704dd52-8db1-4ffe-9a77-a3b05edd4c3c service nova] Creating event network-vif-deleted:d4344f22-bad7-4ad7-8549-d8b5a9bbb4e5 for instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 on hv-cinder-84456 Sep 28 08:40:00.641358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-99543492-db4d-4367-b71b-86610f5ac0c6 req-8704dd52-8db1-4ffe-9a77-a3b05edd4c3c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036575 Sep 28 08:40:00.642301 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 125/276] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:40:00.759662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:00.761139 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:00.791842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:00.792747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:00.793233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:00.794312 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:00.794619 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:00.795054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:00.926879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:00.936103 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-50de35de-dbb1-4bbe-8031-8947c296c3ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1272 microversion: 2.1 time: 0.184285 Sep 28 08:40:00.937114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 152/277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:00 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:01.034710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:01.036639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:01.048219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:01.061786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:01.063903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:01.064788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:01.067332 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:01.068688 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:01.510592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:01.525508 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-15996913-5f7b-4714-97ee-e6aefb23ce1d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.499290 Sep 28 08:40:01.526288 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 126/278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:01 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:01.640380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:01.642365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:01.653355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:01.653355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:01.653747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:01.654680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:01.656113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:01.656746 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:01.696335 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:01.696951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:01.697617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:01.698243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lazy-loading 'fault' on Instance uuid 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:40:01.809317 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9369796f4c5b41d6b9fe1e786fbd4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc7abcbb99b7466fb1581e1010b4a7e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:01.820225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fb958e53-68c8-429f-b8f7-8909e1026b0f tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 200 len: 1350 microversion: 2.1 time: 0.184325 Sep 28 08:40:01.822474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 153/279] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:01 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 1350 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:01.968721 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:01.970671 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:01.977464 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:01.977964 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:01.978400 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:01.979116 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:01.979565 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:01.980214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:02.232299 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:02.245723 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ec9b120c-3796-47c9-b82e-24a2348119ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.281368 Sep 28 08:40:02.246310 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 127/280] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:01 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:02.550576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:02.551305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:02.557941 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:02.558433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:02.558867 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:02.559577 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:02.560032 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:02.560453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:02.853012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:02.853656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:02.860422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:02.860914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:02.863045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:02.863798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:02.864371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:02.864734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:02.886766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] HTTP exception thrown: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Request method failure captured: Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 HTTP/1.1 Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf0twEioJ-HSSOrwuAi13QazbG6DQgtT3hWVM8JRNqY3E81gS94burVAxoUuPT1FXR6Y3r_7xflHj_ZnbdyrUQtQJDJzKUAbD9O-gxZyNGE3AxJIwmENYwwG_eIqqQb5fHkQqE6ubjbl-wfYPsVRcGY05SRoT0fPZRO1caRfFQ4z_0 Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:40:02.895563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7abcbb99b7466fb1581e1010b4a7e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 9369796f4c5b41d6b9fe1e786fbd4b38 Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:02.896895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '8d33c275-10df-4eb8-90a9-e31c4a6f9cb6'} Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:40:02.897746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:02.898862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:02.900697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Returning 404 to user: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:40:02.900697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b5eb0c00-ec39-4e3c-a450-b6d7ce6c2ecb tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 404 len: 111 microversion: 2.1 time: 0.048960 Sep 28 08:40:02.900697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 128/281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:02 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:40:02.904351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:02.913432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-51fdcccb-3299-4c7c-bd83-e3915a68c4b5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.366688 Sep 28 08:40:02.915575 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 154/282] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:02 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:03.064779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:03.076773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:03.088494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:03.089600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:03.090373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:03.091298 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:03.091945 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:03.092605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:03.108474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] HTTP exception thrown: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Request method failure captured: Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6/os-volume_attachments HTTP/1.1 Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf0twEioJ-HSSOrwuAi13QazbG6DQgtT3hWVM8JRNqY3E81gS94burVAxoUuPT1FXR6Y3r_7xflHj_ZnbdyrUQtQJDJzKUAbD9O-gxZyNGE3AxJIwmENYwwG_eIqqQb5fHkQqE6ubjbl-wfYPsVRcGY05SRoT0fPZRO1caRfFQ4z_0 Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:40:03.111647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7abcbb99b7466fb1581e1010b4a7e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 9369796f4c5b41d6b9fe1e786fbd4b38 Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:03.112814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'server_id': '8d33c275-10df-4eb8-90a9-e31c4a6f9cb6'} Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:40:03.113695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:03.114779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:03.118081 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Returning 404 to user: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:40:03.119276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-26f3aa58-5e76-436a-97bc-143c1c7244f7 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.060138 Sep 28 08:40:03.123913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 129/283] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:40:03 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:40:03.182745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-c48e8580-78f1-4289-b814-0e9cd7faa103 req-d3fe10d3-1f81-4ae2-8180-87d662d371eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ccc5d87-c575-4da3-b246-c8b13aaa3b34", "tag": "d8d69f9a-c8fd-4c26-a50e-7609f170d57a"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:03.197646 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c48e8580-78f1-4289-b814-0e9cd7faa103 req-d3fe10d3-1f81-4ae2-8180-87d662d371eb service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:03.198608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c48e8580-78f1-4289-b814-0e9cd7faa103 req-d3fe10d3-1f81-4ae2-8180-87d662d371eb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:03.199286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c48e8580-78f1-4289-b814-0e9cd7faa103 req-d3fe10d3-1f81-4ae2-8180-87d662d371eb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:03.215666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-c48e8580-78f1-4289-b814-0e9cd7faa103 req-d3fe10d3-1f81-4ae2-8180-87d662d371eb service nova] Creating event network-changed:d8d69f9a-c8fd-4c26-a50e-7609f170d57a for instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 on hv-cinder-84456 Sep 28 08:40:03.237123 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-c48e8580-78f1-4289-b814-0e9cd7faa103 req-d3fe10d3-1f81-4ae2-8180-87d662d371eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075896 Sep 28 08:40:03.240267 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 155/284] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:40:03.271724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:03.272360 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:03.280452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:03.280909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:03.281481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:03.282278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:03.282835 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:03.283247 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:03.441397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:03.448666 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0356bd96-108e-41b4-a194-459e363c6c13 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.181033 Sep 28 08:40:03.449268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 130/285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:03 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:03.938560 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:03.939255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:03.945751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:03.946241 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:03.946670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:03.947362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:03.947809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:03.948226 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:04.099391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:04.107094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a4d49348-e014-4751-a5fe-7ba5817fdf00 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.173330 Sep 28 08:40:04.107646 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 156/286] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:03 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:04.473526 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:04.474712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:04.486177 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:04.486902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:04.487407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:04.488197 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:04.488763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:04.489353 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:04.508321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:04.628588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:04.636222 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-30bf1d62-29a4-47b2-b5b5-b04e9337c6ca tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.168128 Sep 28 08:40:04.637002 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 131/287] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:04 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:05.131889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:05.132552 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:05.138865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.139382 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.139791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.140475 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.140975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.141430 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.275654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:05.283772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cea355f5-4b7f-4095-b5c8-c8f5652bb91f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.156530 Sep 28 08:40:05.284336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 157/288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:05 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:05.462395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:05.462894 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:05.468731 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.469760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.470197 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.470887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.471344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.471770 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.485838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] HTTP exception thrown: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Request method failure captured: Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: DELETE /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 HTTP/1.1 Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf0twEioJ-HSSOrwuAi13QazbG6DQgtT3hWVM8JRNqY3E81gS94burVAxoUuPT1FXR6Y3r_7xflHj_ZnbdyrUQtQJDJzKUAbD9O-gxZyNGE3AxJIwmENYwwG_eIqqQb5fHkQqE6ubjbl-wfYPsVRcGY05SRoT0fPZRO1caRfFQ4z_0 Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:40:05.487465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7abcbb99b7466fb1581e1010b4a7e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 9369796f4c5b41d6b9fe1e786fbd4b38 Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.488655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '8d33c275-10df-4eb8-90a9-e31c4a6f9cb6'} Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:40:05.489366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.492343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.494173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Returning 404 to user: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:40:05.494173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5a80233f-262d-4959-b882-5918ce527151 tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 404 len: 111 microversion: 2.1 time: 0.030341 Sep 28 08:40:05.494173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 132/289] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:40:05 2022] DELETE /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:40:05.498187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:05.498806 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] [instance: 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:05.506003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.506528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.506967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.507679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.508127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.508557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.522487 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] HTTP exception thrown: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Request method failure captured: Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 HTTP/1.1 Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf0twEioJ-HSSOrwuAi13QazbG6DQgtT3hWVM8JRNqY3E81gS94burVAxoUuPT1FXR6Y3r_7xflHj_ZnbdyrUQtQJDJzKUAbD9O-gxZyNGE3AxJIwmENYwwG_eIqqQb5fHkQqE6ubjbl-wfYPsVRcGY05SRoT0fPZRO1caRfFQ4z_0 Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:40:05.527146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dc7abcbb99b7466fb1581e1010b4a7e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dc7abcbb99b7466fb1581e1010b4a7e1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: dc7abcbb99b7466fb1581e1010b4a7e1 Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-DeleteServersTestJSON-1519572496 Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 9369796f4c5b41d6b9fe1e786fbd4b38 Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-DeleteServersTestJSON-1519572496-project Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.528701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '8d33c275-10df-4eb8-90a9-e31c4a6f9cb6'} Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:40:05.529580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. Sep 28 08:40:05.531912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:05.533153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] Returning 404 to user: Instance 8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:40:05.533153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c494a75d-61de-4298-b773-5770249849dd tempest-DeleteServersTestJSON-1519572496 tempest-DeleteServersTestJSON-1519572496-project] 10.222.0.52 "GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6" status: 404 len: 111 microversion: 2.1 time: 0.034936 Sep 28 08:40:05.533153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 158/290] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:05 2022] GET /compute/v2.1/servers/8d33c275-10df-4eb8-90a9-e31c4a6f9cb6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:40:05.660479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:05.661269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:05.667664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.668269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.668719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.669653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:05.670216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:05.671639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:05.930197 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:05.940228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e84f5202-7e59-4514-8777-aea9a72c7dbc tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.284087 Sep 28 08:40:05.941880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 133/291] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:05 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:06.306883 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:06.307658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:06.314359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:06.314952 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:06.315453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:06.316410 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:06.316934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:06.317455 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:06.603570 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:06.611965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3524be44-7377-49b9-b1f2-54d0d72a26ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.309134 Sep 28 08:40:06.612540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 159/292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:06 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:06.967817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:06.970890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:06.980148 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:06.980645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:06.981293 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:06.982012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:06.982471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:06.982897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:07.224783 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:07.232737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-16f387f8-cae4-483b-bb49-39972dd0b900 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.271890 Sep 28 08:40:07.245297 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 134/293] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:06 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:07.635364 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:07.636672 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:07.643368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:07.644566 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:07.645299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:07.646241 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:07.646915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:07.647555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:08.137725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:08.147202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7d9b67b0-cc0d-44db-bca8-191b897b4abe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.516216 Sep 28 08:40:08.150950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 160/294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:07 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:08.257903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:08.259126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:08.271633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:08.281821 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:08.282433 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:08.283293 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:08.283904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:08.284561 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:08.532203 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:08.606913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:08.625843 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-475bd5c0-3032-4ada-8816-9b84570f21fe tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.371459 Sep 28 08:40:08.627172 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 135/295] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:08 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:09.177979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:09.178715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:09.185484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:09.186325 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:09.186961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:09.188961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:09.189654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:09.190950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:09.192016 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:09.192708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:09.193444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:09.374842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:09.392177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a80c65c8-cab3-4ea9-a002-62629afd64e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.217466 Sep 28 08:40:09.397724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 161/296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:09 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:09.668230 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:09.669015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:09.676951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:09.677964 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:09.680644 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:09.681653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:09.683896 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:09.684457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:09.987581 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:09.996426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-872210fa-1b84-4e09-8224-1426a04a4e35 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.346524 Sep 28 08:40:09.997679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 136/297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:09 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:10.416281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:10.416822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:10.423681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:10.424169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:10.424667 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:10.425405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:10.426182 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:10.427158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:10.691615 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:10.699293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-991156c1-93ae-4aac-9270-c1d2219f7912 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.287442 Sep 28 08:40:10.699858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 162/298] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:10 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:11.029325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:11.030098 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:11.039182 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:11.039750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:11.040517 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:11.041723 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:11.042358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:11.042934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:11.258188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:11.269794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7df465d1-f40f-46d6-bda1-31b7cc77875e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.253786 Sep 28 08:40:11.284590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 137/299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:11 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:11.724850 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:11.725836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:11.732327 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:11.732968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:11.736751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:11.736751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:11.736751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:11.736751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:11.881735 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:11.892187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4b61acd3-c873-4ad8-93b3-f2b64bc7d0e0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.171812 Sep 28 08:40:11.892907 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 163/300] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:11 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:12.296365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:12.297029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:12.303981 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:12.304603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:12.305626 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:12.306617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:12.307231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:12.308043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:12.452889 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:12.460837 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-79734e1c-7859-4d01-8c0e-a963fe470bcb tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.168474 Sep 28 08:40:12.461443 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 138/301] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:12 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:12.918734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:12.919357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:12.934646 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:12.935277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:12.935583 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:12.936288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:12.944343 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:12.944792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:13.117425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:13.127408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ddc9156f-79ff-4bc1-b235-f32581f397ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.212707 Sep 28 08:40:13.144416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 164/302] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:12 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:13.484392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:13.485662 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:13.493057 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:13.493812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:13.494402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:13.495259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:13.495858 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:13.496419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:13.760512 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:13.779150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-faee989a-1296-4f70-8f0b-429c3a553e33 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.299356 Sep 28 08:40:13.780013 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 139/303] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:13 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:14.153885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:14.154578 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:14.162671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:14.165998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:14.172565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:14.173580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:14.174207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:14.174817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:14.440940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:14.450681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-90eb2378-8ddf-47a3-844a-54c9fe28f143 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.300690 Sep 28 08:40:14.451555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 165/304] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:14 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:14.801531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:14.802761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:14.811105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=60 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:14.812811 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:14.813391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:14.814012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:14.815099 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:14.815722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:14.816154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:15.155453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-6b3fef47-bb45-4bf1-bc3a-e37063b9140d req-1bf41218-0c91-401a-92b8-09bf37600476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ccc5d87-c575-4da3-b246-c8b13aaa3b34", "name": "network-vif-plugged", "status": "completed", "tag": "d8d69f9a-c8fd-4c26-a50e-7609f170d57a"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:15.160100 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:15.174852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6fe05555-1acf-4592-baae-4793bfcf0f7d tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.374264 Sep 28 08:40:15.175735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 140/305] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:14 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:15.185368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-6b3fef47-bb45-4bf1-bc3a-e37063b9140d req-1bf41218-0c91-401a-92b8-09bf37600476 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:15.185858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-6b3fef47-bb45-4bf1-bc3a-e37063b9140d req-1bf41218-0c91-401a-92b8-09bf37600476 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:15.186291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-6b3fef47-bb45-4bf1-bc3a-e37063b9140d req-1bf41218-0c91-401a-92b8-09bf37600476 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:15.210354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-6b3fef47-bb45-4bf1-bc3a-e37063b9140d req-1bf41218-0c91-401a-92b8-09bf37600476 service nova] Creating event network-vif-plugged:d8d69f9a-c8fd-4c26-a50e-7609f170d57a for instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 on hv-cinder-84456 Sep 28 08:40:15.218612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-6b3fef47-bb45-4bf1-bc3a-e37063b9140d req-1bf41218-0c91-401a-92b8-09bf37600476 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066728 Sep 28 08:40:15.220507 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 166/306] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:40:15.475242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:15.476474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:15.490802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:15.491359 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:15.494345 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:15.495127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:15.501892 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:15.501990 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:15.690435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:15.701152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0ec7f49a-a408-493a-8d2c-09151b74a8ec tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.230053 Sep 28 08:40:15.702157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 141/307] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:15 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:16.200894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:16.201715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:16.216474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:16.216976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:16.217486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:16.218204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:16.219870 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:16.220308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:16.245720 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:16.469383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:16.483595 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-98752019-0992-4162-93a8-e366c7a5af64 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.287278 Sep 28 08:40:16.486079 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 167/308] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:16 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:16.726007 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:16.726681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:16.754294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:16.754804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:16.755245 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:16.755951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:16.761826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:16.763908 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:17.053565 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:17.061877 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9530c4be-5056-4198-969b-924acefc57a3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1522 microversion: 2.1 time: 0.340888 Sep 28 08:40:17.065983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 142/309] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:16 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:17.516625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:17.522869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:17.559354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:17.559858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:17.560295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:17.566195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:17.569051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:17.570930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:17.959173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:17.971663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c20a9f54-2eaf-4a40-9223-a07af76219b6 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.464735 Sep 28 08:40:17.972967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 168/310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:17 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:18.087153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:18.088842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:18.097168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:18.097895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:18.098484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:18.099362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:18.099990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:18.100577 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:18.184178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-819251cb-66f4-49c5-a504-b7188207754a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'create', calling method: .version_select at 0x7f984fe3dca0>, body: {"keypair": {"name": "tempest-keypair-1791126393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+PCzbbvUZl7TfmXSXXYUEvzagLlTALekt+n9hVpihUWuI/+j+oZZShz6Zo05OJdDWjO4MilUwuMa++0EeFMTNj3wTNeVIcKKpzYjI1+6MbPY5vAXKYpa/8I4PUTnXT2A=="}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:18.202924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-819251cb-66f4-49c5-a504-b7188207754a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for project c067f1df3c7f47299bc2db03d904d156. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:40:18.207729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-819251cb-66f4-49c5-a504-b7188207754a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for user b0cbf49cfca74838bee4c8162dfe27ef and project c067f1df3c7f47299bc2db03d904d156. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:40:18.242874 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-819251cb-66f4-49c5-a504-b7188207754a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.226204 Sep 28 08:40:18.243759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 143/311] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Sep 28 08:40:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 229 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 28 08:40:18.343628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:18.364467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2902d0bd-6e94-4ea5-8a23-ac5831b95f6b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1502 microversion: 2.1 time: 0.282692 Sep 28 08:40:18.395604 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:18.396322 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:18.401852 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 169/312] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:18 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:18.410742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:18.412185 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:18.413514 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:18.415202 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:18.416264 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:18.416934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:18.738559 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:18.746519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-599368a2-04a1-4a9b-934f-3ff36bb63012 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1515 microversion: 2.1 time: 0.356220 Sep 28 08:40:18.747683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 144/313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:18 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:18.997384 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:18.998606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:19.008896 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:19.009962 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:19.011842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:19.013379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:19.016119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:19.018413 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:19.359611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:19.367945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7b53c3af-a77e-43d9-bdab-ede5e53be43b tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1314 microversion: 2.1 time: 0.375990 Sep 28 08:40:19.368531 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 170/314] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:18 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:20.389918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-166716670", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e213c79-0ba4-458e-84ef-70d744799a89"}], "security_groups": [{"name": "tempest-securitygroup--1839691978"}], "key_name": "tempest-keypair-1791126393", "user_data": "}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:20.392114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:20.393520 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:20.402693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:20.403210 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:20.403649 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:20.409482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:20.410195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:20.411198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:20.703404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] validate_networks() for [('8e213c79-0ba4-458e-84ef-70d744799a89', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:40:21.135518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:21.157562 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-74945e57-cec0-4b32-adee-4c368f026834 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1464 microversion: 2.1 time: 0.768694 Sep 28 08:40:21.176286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 171/315] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:20 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1464 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:21.193164 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:21.196231 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:21.206939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:21.207778 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:21.208707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:21.209672 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:21.210308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:21.211253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:21.437199 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'flavor' on Instance uuid 53562009-e64b-47ed-8dd7-890647fe3e44 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:40:21.583763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8da7e208-5120-4066-b430-867736d7376d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44/action" status: 200 len: 32 microversion: 2.1 time: 0.404760 Sep 28 08:40:21.584934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 172/316] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:40:21 2022] POST /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44/action => generated 32 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:40:21.601157 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:21.602935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:21.610601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:21.611430 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:21.612056 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:21.613029 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:21.613721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:21.614372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:21.677669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:40:21.833750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-58d3a707-1501-4d77-9c5c-3106c796bdaa tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 204 len: 0 microversion: 2.1 time: 0.237618 Sep 28 08:40:21.837924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 173/317] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:40:21 2022] DELETE /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:40:21.843591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:21.844550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:21.860618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:21.861546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:21.863510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:21.864483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:21.865723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:21.866221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:21.984494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:40:21.984982 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:40:21.986099 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:40:21.986577 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:40:21.987719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:40:21.999619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:22.000630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:22.001060 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:22.001864 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:22.002312 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:22.002735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:22.030389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for project c067f1df3c7f47299bc2db03d904d156. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:40:22.035933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for user b0cbf49cfca74838bee4c8162dfe27ef and project c067f1df3c7f47299bc2db03d904d156. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:40:22.050482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:40:22.052950 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:40:22.114712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7e01463f-a359-434c-a95a-f9b509671761 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.731119 Sep 28 08:40:22.116124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 145/318] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Sep 28 08:40:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 08:40:22.121763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:22.122774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:22.129740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:22.135177 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:22.143606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-506fd9e1-d991-4465-93cf-429f698f8d5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.303192 Sep 28 08:40:22.145033 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 174/319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:21 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:22.152113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ea9fb8aa-0bac-43cd-ba71-9fa8de4f06da tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:22.152975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ea9fb8aa-0bac-43cd-ba71-9fa8de4f06da tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:22.158563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:22.160720 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:22.165720 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:22.166404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:22.166985 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:22.450820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ea9fb8aa-0bac-43cd-ba71-9fa8de4f06da tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:22.468323 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ea9fb8aa-0bac-43cd-ba71-9fa8de4f06da tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:22.470069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ea9fb8aa-0bac-43cd-ba71-9fa8de4f06da tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:22.478653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ea9fb8aa-0bac-43cd-ba71-9fa8de4f06da tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1281 microversion: 2.20 time: 0.331645 Sep 28 08:40:22.479245 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 175/320] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:22 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1281 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:22.859733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:22.872049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-95c4439e-786b-4fd2-9c14-0cbca12d655c tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1470 microversion: 2.1 time: 0.754041 Sep 28 08:40:22.872640 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 146/321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:22 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1470 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:23.176640 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:23.177278 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:23.193158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:23.194592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:23.195333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:23.196572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:23.197795 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:23.198838 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:23.478516 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:23.507485 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:23.508885 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:23.512268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-557e252c-a418-4edb-8b53-a42796b97986 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.329384 Sep 28 08:40:23.514907 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 176/322] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:23 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:23.532911 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:23.533449 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:23.533891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:23.534610 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:23.535066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:23.535496 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:23.791685 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:23.806400 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:23.808314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:23.814244 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d0a9838a-ba15-40ee-9b57-84345fc23b61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1285 microversion: 2.20 time: 0.311126 Sep 28 08:40:23.838150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 147/323] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:23 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1285 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:23.904751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:23.905715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:23.917922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:23.918410 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:23.921028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:23.922804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:23.923882 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:23.924463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:24.482426 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:24.495855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c8fa2420-06eb-4e8b-99ef-6e60090872ee tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1470 microversion: 2.1 time: 0.596371 Sep 28 08:40:24.503897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 177/324] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:23 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1470 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:24.537544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:24.538879 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:24.560793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:24.566316 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:24.567917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:24.575630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:24.576733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:24.578219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:24.847287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:24.847913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:24.862451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:24.869776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:24.872589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:24.875377 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:24.877477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:24.879435 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:25.023822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:25.032857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4bd9f75a-1f01-44a3-a6ec-eaca888cc89e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.499309 Sep 28 08:40:25.033700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 148/325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:24 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:25.143546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:25.164844 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:25.168555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:25.172357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6661fa01-0167-4aee-a5a4-80cc29039be2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1341 microversion: 2.20 time: 0.329807 Sep 28 08:40:25.175258 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 178/326] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:24 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1341 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:25.311728 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-d50eab45-030b-4607-ad2f-639080f8344d req-a6f3b401-802a-4b0a-a5be-bb92cd565fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ccc5d87-c575-4da3-b246-c8b13aaa3b34", "name": "network-vif-deleted", "tag": "d8d69f9a-c8fd-4c26-a50e-7609f170d57a"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:25.334282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-d50eab45-030b-4607-ad2f-639080f8344d req-a6f3b401-802a-4b0a-a5be-bb92cd565fb7 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:25.340404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-d50eab45-030b-4607-ad2f-639080f8344d req-a6f3b401-802a-4b0a-a5be-bb92cd565fb7 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:25.341028 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-d50eab45-030b-4607-ad2f-639080f8344d req-a6f3b401-802a-4b0a-a5be-bb92cd565fb7 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:25.365972 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-d50eab45-030b-4607-ad2f-639080f8344d req-a6f3b401-802a-4b0a-a5be-bb92cd565fb7 service nova] Creating event network-vif-deleted:d8d69f9a-c8fd-4c26-a50e-7609f170d57a for instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 on hv-cinder-84456 Sep 28 08:40:25.376337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-d50eab45-030b-4607-ad2f-639080f8344d req-a6f3b401-802a-4b0a-a5be-bb92cd565fb7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068243 Sep 28 08:40:25.379904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 149/327] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:40:25.529958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:25.530579 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:25.543180 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:25.543601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:25.570667 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:25.572186 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:25.572935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:25.573135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:25.779976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c45623c9421460abfa049a8040c7c12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3777d8561b4e4c9385e87007b37fa57a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:25.794455 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3384448d-0336-40ba-9307-44f74dd51c2e tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 200 len: 1299 microversion: 2.1 time: 0.268288 Sep 28 08:40:25.817476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 179/328] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:25 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 1299 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:26.060804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:26.062744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:26.081408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:26.082534 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:26.083466 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:26.084759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:26.085506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:26.088186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:26.203596 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:26.204480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:26.221452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:26.222249 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:26.223519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:26.226296 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:26.227336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:26.228303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:26.629446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:26.658881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6b10780b-0439-4985-96bb-68dbdc40b790 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.589873 Sep 28 08:40:26.664128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 150/329] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:26 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:26.823580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:26.824519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] [instance: 9ccc5d87-c575-4da3-b246-c8b13aaa3b34] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:26.832743 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:26.834173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:26.836957 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:26.837930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:26.840468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:26.847251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:26.847817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:26.849578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:26.853670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:26.855080 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-786ed7f1-f18b-4377-9cda-137bd4339a69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.657726 Sep 28 08:40:26.858298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 180/330] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:26 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:26.877265 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:26.890861 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] HTTP exception thrown: Instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 could not be found. Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Request method failure captured: Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 HTTP/1.1 Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAhbEhYt7KlX9XaCPkwL_D59wuzk1QIRb9WReIhzocuzH28h7IRM7FPJKjS9pcpMyuwekKD-ydbF5hS0UzfeMrrVvFJx3yEmhUdfBebqy7oOf0pJihKe2lP8LRf1g-5DtsMXF2QT87ecmeGYyNmneuzgsv1dBKigBLbYSpojJ_A0hG8 Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 3777d8561b4e4c9385e87007b37fa57a Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-VolumesNegativeTest-1308331695 Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:40:26.894570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3777d8561b4e4c9385e87007b37fa57a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3777d8561b4e4c9385e87007b37fa57a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3777d8561b4e4c9385e87007b37fa57a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3777d8561b4e4c9385e87007b37fa57a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-VolumesNegativeTest-1308331695 Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 3777d8561b4e4c9385e87007b37fa57a Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-VolumesNegativeTest-1308331695 Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-VolumesNegativeTest-1308331695-project Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 5c45623c9421460abfa049a8040c7c12 Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-VolumesNegativeTest-1308331695-project Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 could not be found. Sep 28 08:40:26.895913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '9ccc5d87-c575-4da3-b246-c8b13aaa3b34'} Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 could not be found. Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:40:26.896633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 could not be found. Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 could not be found. Sep 28 08:40:26.897796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:40:26.901308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] Returning 404 to user: Instance 9ccc5d87-c575-4da3-b246-c8b13aaa3b34 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:40:26.901308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d41335c9-36d5-448f-aa04-be7d314b5bb1 tempest-VolumesNegativeTest-1308331695 tempest-VolumesNegativeTest-1308331695-project] 10.222.0.52 "GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34" status: 404 len: 111 microversion: 2.1 time: 0.082113 Sep 28 08:40:26.903871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 151/331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:26 2022] GET /compute/v2.1/servers/9ccc5d87-c575-4da3-b246-c8b13aaa3b34 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:40:27.694212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:27.694840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:27.701512 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:27.709947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:27.723728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:27.725830 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:27.729314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:27.729541 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:27.772896 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:27.885411 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:27.886037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:27.905530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:27.909370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:27.910289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:27.912228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:27.914499 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:27.915250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:28.123405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:28.134681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:28.138723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dbbfe993-361d-4bc5-ae44-7c290db805e2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.452106 Sep 28 08:40:28.139998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 181/332] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:27 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:28.151102 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:28.152569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:28.153741 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ab0b2a6b-7b3d-4a2b-81d5-b7ed417142ce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.273855 Sep 28 08:40:28.154294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 152/333] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:27 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:28.610559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-029f94e7-18d4-4e6a-b9f5-9ca056a934fa req-2896a40c-0e14-4344-8074-1c5f67bbc594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4", "tag": "34490fea-8100-40b7-919a-078c2cfc5f1d"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:28.653791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-029f94e7-18d4-4e6a-b9f5-9ca056a934fa req-2896a40c-0e14-4344-8074-1c5f67bbc594 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:28.654281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-029f94e7-18d4-4e6a-b9f5-9ca056a934fa req-2896a40c-0e14-4344-8074-1c5f67bbc594 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:28.654715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-029f94e7-18d4-4e6a-b9f5-9ca056a934fa req-2896a40c-0e14-4344-8074-1c5f67bbc594 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:28.682311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-029f94e7-18d4-4e6a-b9f5-9ca056a934fa req-2896a40c-0e14-4344-8074-1c5f67bbc594 service nova] Creating event network-changed:34490fea-8100-40b7-919a-078c2cfc5f1d for instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 on hv-cinder-84456 Sep 28 08:40:28.687779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-029f94e7-18d4-4e6a-b9f5-9ca056a934fa req-2896a40c-0e14-4344-8074-1c5f67bbc594 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081343 Sep 28 08:40:28.688994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 182/334] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:40:29.168295 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:29.170242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:29.183293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:29.183783 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:29.183783 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:29.184010 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:29.184336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:29.185283 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:29.185991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:29.187161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:29.192744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:29.193653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:29.194243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:29.195770 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:29.196702 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:29.197347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:29.529137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:29.557421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-faef2174-a9d4-4d63-8d48-409ef554e00a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.395837 Sep 28 08:40:29.562412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 153/335] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:29 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:29.567229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:29.593792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:29.595874 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:29.601679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c73eac70-bcfa-45a9-867a-c0cff224a570 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.424356 Sep 28 08:40:29.604990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 183/336] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:29 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:30.592709 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:30.594482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:30.601701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:30.602597 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:30.603048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:30.604216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:30.604810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:30.605357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:30.635491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:30.636134 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:30.650830 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:30.654499 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:30.654796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:30.655522 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:30.656032 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:30.656713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:31.207190 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:31.215117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0fbbcd58-4093-410a-9c3f-ba12658f0af8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.635687 Sep 28 08:40:31.215692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 154/337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:30 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:31.267712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:31.276192 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:31.278333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:31.281364 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-84eb7253-8009-42ac-b86a-55d9f58cd056 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.655516 Sep 28 08:40:31.283037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 184/338] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:30 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:32.244656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:32.246076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:32.248742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:32.250760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=10 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:32.257184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:32.257684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:32.258305 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:32.259191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:32.259808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:32.260294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:32.312693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:32.314834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:32.323528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:32.324986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:32.326227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:32.327327 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:32.328023 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:32.329643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:32.460155 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:32.500311 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:32.514732 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9d8fdc94-dad2-4c39-975f-eb76a0917ef6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.276898 Sep 28 08:40:32.531664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 155/339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:32 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:32.544550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:32.554135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:32.555601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:32.556726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-07de2996-9102-4dc5-a6ed-b9550e28a534 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.248988 Sep 28 08:40:32.559639 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 185/340] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:32 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:33.255300 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9e339794-bc73-44cd-83ac-e744d2be8ddf tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Action: 'create', calling method: .version_select at 0x7f984ff339d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1228999444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbat8yR5sjhuHYqw9A16xaWvdIBMORG0nV70fjMtOa9Qtue1Jc9d9EPq38thpe9EEEBo8+LcjhLN2wMzCpckzzXPa8kV62Qh58DkSAZrZnufYW/gFLTQkpXA0Xb/TdMkw=="}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:33.283440 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-9e339794-bc73-44cd-83ac-e744d2be8ddf tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Getting quotas for project c507f95ba3c34cc789ee8903b40c346d. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:40:33.288317 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-9e339794-bc73-44cd-83ac-e744d2be8ddf tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Getting quotas for user 4f250207e16c4515bd9beb9ca4b1fde6 and project c507f95ba3c34cc789ee8903b40c346d. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:40:33.320403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9e339794-bc73-44cd-83ac-e744d2be8ddf tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.411455 Sep 28 08:40:33.321070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 156/341] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:40:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:40:33.544429 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:33.548184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:33.559203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:33.559708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:33.560209 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:33.560930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:33.561668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:33.561877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:33.585378 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:33.586047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:33.599989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:33.600397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:33.601030 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:33.601897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:33.602351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:33.602773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:33.916023 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:33.925609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:33.927073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:33.928206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8e6e55bb-4a04-493a-90e8-c7a4bbb14fce tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.347373 Sep 28 08:40:33.933243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 157/342] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:33 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:33.936920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:33.945714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3179322d-d5cd-4bdc-9fb2-fc291682b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.406224 Sep 28 08:40:33.951277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 186/343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:33 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:34.953393 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:34.954077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:34.970042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:34.971202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:34.975014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:34.978333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:34.980143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:34.980750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:34.982139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:34.984402 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:34.984844 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:34.985593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:34.986049 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:34.986472 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:34.991084 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:34.991516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:35.294325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:35.307182 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:35.321574 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:35.321574 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e44f84ae-fed9-4767-ad4c-b7b7a5f77e20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.360873 Sep 28 08:40:35.331752 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 158/344] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:34 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:35.333550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:35.345002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7f096d45-f0a1-4eaa-a55c-9507d63c9558 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.378617 Sep 28 08:40:35.347054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 187/345] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:34 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:36.338820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:36.339689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:36.346381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:36.346869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:36.347306 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:36.348034 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:36.348484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:36.348915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:36.376974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:36.377923 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:36.407270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:36.407779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:36.408236 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:36.410439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:36.410439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:36.410439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:36.614832 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:36.623674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:36.625494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:36.626608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-da99c104-75ec-4482-bf33-08d8d2d3d233 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.291695 Sep 28 08:40:36.641598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 159/346] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:36 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:36.648190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:36.660319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bbbca517-3301-420b-864a-e00edb66fe42 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.287932 Sep 28 08:40:36.660810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 188/347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:36 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:37.662845 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:37.664172 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:37.672030 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:37.672773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:37.673402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:37.674281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:37.674884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:37.675475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:37.688875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:37.689638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:37.696132 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:37.696590 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:37.697039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:37.706321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:37.707120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:37.708006 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:37.931483 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:37.962831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:37.964281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:37.965457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2725e925-a693-42f4-ae7b-921676ef117b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.309973 Sep 28 08:40:37.966028 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 160/348] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:37 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:37.977481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:37.992087 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-7fd9d315-bef0-487f-87da-ff91a37f3bc7 req-9522c839-435d-4d84-ac2b-6a05e7a2f1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4", "name": "network-vif-plugged", "status": "completed", "tag": "34490fea-8100-40b7-919a-078c2cfc5f1d"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:37.995040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5a290bb2-4647-475c-8d73-6bb25b35281a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.312181 Sep 28 08:40:37.995669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 189/349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:37 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:38.021504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-7fd9d315-bef0-487f-87da-ff91a37f3bc7 req-9522c839-435d-4d84-ac2b-6a05e7a2f1fb service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:38.022126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-7fd9d315-bef0-487f-87da-ff91a37f3bc7 req-9522c839-435d-4d84-ac2b-6a05e7a2f1fb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:38.022653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-7fd9d315-bef0-487f-87da-ff91a37f3bc7 req-9522c839-435d-4d84-ac2b-6a05e7a2f1fb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:38.035998 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-7fd9d315-bef0-487f-87da-ff91a37f3bc7 req-9522c839-435d-4d84-ac2b-6a05e7a2f1fb service nova] Creating event network-vif-plugged:34490fea-8100-40b7-919a-078c2cfc5f1d for instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 on hv-cinder-84456 Sep 28 08:40:38.043724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-7fd9d315-bef0-487f-87da-ff91a37f3bc7 req-9522c839-435d-4d84-ac2b-6a05e7a2f1fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069645 Sep 28 08:40:38.044351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 161/350] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:40:38.996035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:38.996653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:39.004428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:39.004921 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:39.005388 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:39.006105 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:39.006563 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:39.006989 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:39.019509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:39.020832 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:39.028068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:39.028657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:39.029202 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:39.029980 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:39.030512 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:39.031005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:39.222383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:39.226638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:39.231726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:39.235942 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1ba34616-b2cf-4d98-ac65-ee89cb276db7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.220662 Sep 28 08:40:39.237068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 162/351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:39 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:39.244187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:39.245608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3796fafa-867e-4f73-a12a-dde958b6ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.253994 Sep 28 08:40:39.246329 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 190/352] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:38 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:40.259220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:40.259881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:40.266414 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:40.266907 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:40.267349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:40.268044 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:40.268502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:40.268936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:40.270101 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:40.270710 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:40.273635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:40.277309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:40.277793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:40.278227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:40.278920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:40.279372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:40.279796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:40.468229 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:40.471369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:40.476439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ac4613aa-95f4-4780-b21a-ce84a16a0fd2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.221111 Sep 28 08:40:40.477001 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 163/353] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:40 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:40.480168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:40.481707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:40.482784 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7c4c9982-850c-4f3f-ba26-c6d84b47d37d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.216489 Sep 28 08:40:40.483324 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 191/354] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:40 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:41.499704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:41.501176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:41.508967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:41.509584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:41.509749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:41.509993 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:41.510442 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:41.511145 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:41.511608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:41.512037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:41.515632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:41.516724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:41.517288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:41.517990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:41.518437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:41.518868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:41.711600 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:41.714106 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:41.720800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:41.722076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-af577ef7-7928-4c47-ad5a-d40bcbbdcde0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.226217 Sep 28 08:40:41.722298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:41.722641 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 164/355] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:41 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:41.723505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-40cc135b-0684-4571-9c91-fb105143cfc6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.219337 Sep 28 08:40:41.724185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 192/356] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:41 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:42.747088 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:42.747700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:42.755674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:42.757840 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:42.758324 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:42.759483 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:42.759653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:42.760131 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:42.760833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:42.761948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:42.770338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:42.770835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:42.771266 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:42.771974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:42.772423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:42.772848 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:42.978370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:42.986091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6f81ec9a-ad88-4f08-aa49-01fac35c6a8c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.242821 Sep 28 08:40:42.986319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:42.986659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 165/357] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:42 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:42.994588 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:42.996064 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:42.997257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-061f5dce-7931-4ab0-a866-a1754e2c8c37 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.242438 Sep 28 08:40:42.997821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 193/358] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:42 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:44.008447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:44.009055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:44.011098 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=4 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:44.017743 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:44.018236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:44.018678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:44.019378 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:44.019838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:44.020268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:44.024510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:44.025346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:44.032262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:44.032813 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:44.033281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:44.034520 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:44.034977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:44.035401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:44.224034 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:44.228016 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:44.231822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d1186999-047f-4000-af6c-f7c130964101 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.227153 Sep 28 08:40:44.232396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 166/359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:44 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:44.236396 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:44.237888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:44.239018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a24329f4-7937-4fe1-99cb-a5b7715cc221 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.218519 Sep 28 08:40:44.239539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 194/360] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:44 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:40:45.254544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:45.255737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:45.258054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:45.263568 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:45.264056 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:45.264188 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:45.264603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:45.264791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:45.265203 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:45.265664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:45.266090 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:45.270949 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:45.271428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:45.271856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:45.272543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:45.272990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:45.273437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:45.420538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:45.428878 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:45.430497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:45.431618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c4df32df-f63e-4ed0-ae4f-a0495a921629 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.171503 Sep 28 08:40:45.432166 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 195/361] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:45 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:45.536985 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:45.545331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fb141905-0438-472a-aaa6-35230d1816d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.294612 Sep 28 08:40:45.545969 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 167/362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:45 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:46.456374 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:46.456985 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:46.462940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:46.463424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:46.463860 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:46.464556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:46.465011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:46.465471 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:46.568154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:46.568761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:46.575228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:46.575717 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:46.576156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:46.576857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:46.577337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:46.577759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:46.598818 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:46.607836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:46.609320 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:46.610676 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-26841d05-8b5b-4637-b05d-f9930abff92a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.158707 Sep 28 08:40:46.611504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 196/363] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:46 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:46.708480 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:46.716051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-28912668-aa28-480a-92c4-6e3ba7276486 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.152235 Sep 28 08:40:46.716605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 168/364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:46 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:47.636174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:47.636779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:47.643187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:47.643755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:47.644092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:47.644782 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:47.645257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:47.645682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:47.738795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:47.739401 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:47.745873 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:47.746371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:47.746807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:47.747509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:47.748153 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:47.748587 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:47.778318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:47.787394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:47.788947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:47.790494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e7c3d4d1-8cf8-4bed-9216-c50b0250c92f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.157955 Sep 28 08:40:47.791314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 197/365] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:47 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:47.881031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:47.889036 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-874c4f87-c18d-4014-a715-ba30ccd69613 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.154047 Sep 28 08:40:47.889625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 169/366] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:47 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:48.814695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:48.815348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:48.821333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:48.821821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:48.822256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:48.822945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:48.823401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:48.823830 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:48.913585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:48.914320 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:48.921683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:48.922174 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:48.922615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:48.923896 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:48.924365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:48.924791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:48.929117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:48.954557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:48.956750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:40:48.964065 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:48.965532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:48.966664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-691904d8-9881-4076-b528-59ea53055bca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.155900 Sep 28 08:40:48.967227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 198/367] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:48 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:49.057032 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:49.064656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5a0c2aae-48ed-4c3f-b959-dedb3426c51e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.155328 Sep 28 08:40:49.065294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 170/368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:48 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:49.992944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:49.993619 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:49.999732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.000212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.000645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.002004 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.002462 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.002887 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.087348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:50.087969 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:50.094805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.095308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.095747 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.096454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.096910 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.097371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.131293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:50.142831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:50.144371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:50.145528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2c318746-121b-486a-b05c-a4ff1f189644 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.156522 Sep 28 08:40:50.146085 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 199/369] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:49 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:50.241608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:50.249766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7c5bbc98-ca39-42a8-a500-ae4f0f5d45c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1501 microversion: 2.1 time: 0.165976 Sep 28 08:40:50.250219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 171/370] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:50 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:50.272854 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fc2378-a487-41fc-8825-f1748c729b4b"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:50.275253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:50.281653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.281861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.282248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.283464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.283909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.284864 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.310267 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] HTTP exception thrown: Cannot 'attach_volume' instance 53562009-e64b-47ed-8dd7-890647fe3e44 while it is in vm_state rescued Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Request method failure captured: Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: POST /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44/os-volume_attachments HTTP/1.1 Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 74 Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf1E8anRpf9Y3Phr433YXemtTmRCIPS0gN4YK9hNtuYt44jxbho8BovV3qNnp3m2RFR2ibzPeasINTLiedCt52ce5SAyNjwFYwpWLPhGBJqSFGpHL1zJfQbGgFFriB_YBnLHbC80pjy61XCtUIULs1ZgDjNtyRekNy3hLZpD_ANccU Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:40:50.312003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42699952850d49fdafb670aeb5f613ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7d712e201f2c47a8a48b6e24559e0d60 Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {"volumeAttachment": {"volumeId": "e9fc2378-a487-41fc-8825-f1748c729b4b"}} Sep 28 08:40:50.313369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Cannot 'attach_volume' instance 53562009-e64b-47ed-8dd7-890647fe3e44 while it is in vm_state rescued Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'server_id': '53562009-e64b-47ed-8dd7-890647fe3e44', 'body': {'volumeAttachment': {'volumeId': 'e9fc2378-a487-41fc-8825-f1748c729b4b'}}} Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 53562009-e64b-47ed-8dd7-890647fe3e44 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:40:50.314511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 53562009-e64b-47ed-8dd7-890647fe3e44 while it is in vm_state rescued Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:40:50.316040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:40:50.317136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:40:50.317136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:40:50.317136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 53562009-e64b-47ed-8dd7-890647fe3e44 while it is in vm_state rescued Sep 28 08:40:50.317136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:40:50.317136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Returning 409 to user: Cannot 'attach_volume' instance 53562009-e64b-47ed-8dd7-890647fe3e44 while it is in vm_state rescued {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:40:50.317136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4c41596f-a6bf-46ae-a0ec-697e4226e931 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044636 Sep 28 08:40:50.317136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 200/371] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:40:50 2022] POST /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 08:40:50.325484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:50.325788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:50.332028 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.332801 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.333207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.333927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.334382 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.334798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.415853 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-78dd3166-981f-4615-9091-f506a69d8deb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44/action" status: 202 len: 0 microversion: 2.1 time: 0.094680 Sep 28 08:40:50.416724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 172/372] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:40:50 2022] POST /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:40:50.426384 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:50.427152 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:50.433820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.434311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.434751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.435452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:50.435910 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:50.436331 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:50.572512 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:50.581029 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dae194f7-374c-43ac-9562-b821f7c14f2f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.159771 Sep 28 08:40:50.581771 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 201/373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:50 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:40:51.172049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:51.172776 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:51.179503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:51.179989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:51.180432 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:51.181147 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:51.181609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:51.182038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:51.314712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:51.322784 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:51.324220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:51.325347 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5fd61cc8-d4a6-4e93-ae5b-85900ac5d7ed tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.158166 Sep 28 08:40:51.325890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 173/374] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:51 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:51.605781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:51.606389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:51.613069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:51.613578 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:51.614011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:51.614697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:51.615149 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:51.615575 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:51.747289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:51.755042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-eb8b8376-e915-4e4d-a087-24d961e7e745 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.153086 Sep 28 08:40:51.755600 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 202/375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:51 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:52.351314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:52.351903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:52.358681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:52.359163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:52.359596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:52.360296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:52.361280 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:52.361708 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:52.489003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:52.496923 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:52.498380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:52.499475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ec24bb1a-b9a9-4f4a-a528-c62f18897573 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.152211 Sep 28 08:40:52.500022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 174/376] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:52 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:52.778047 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:52.778645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:52.785075 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:52.785582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:52.786106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:52.786794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:52.787240 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:52.787660 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:52.924168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:52.931788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6a646944-8c26-47a8-a7b9-faa504d43cc9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.157724 Sep 28 08:40:52.932340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 203/377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:52 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:53.524118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:53.524750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:53.531308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:53.531797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:53.532236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:53.532934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:53.533424 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:53.533856 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:53.664571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:53.673543 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:53.675011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:53.676122 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-143a7330-c479-4366-9664-5eb1b290c421 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.155932 Sep 28 08:40:53.676674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 175/378] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:53 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:53.954792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:53.955408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:53.961394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:53.961884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:53.962329 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:53.963020 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:53.963475 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:53.963902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:54.092989 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:54.100582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-19b7f884-63bf-4953-a610-8f7dddae818c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.149718 Sep 28 08:40:54.101155 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 204/379] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:53 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:54.704728 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:54.705395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:54.711765 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:54.712252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:54.712686 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:54.713409 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:54.713867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:54.714296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:54.851949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:54.860242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:54.862381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:54.863484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d8fb5ae0-ecaf-44ba-b6bb-2474255f9416 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.163074 Sep 28 08:40:54.864024 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 176/380] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:54 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:55.123740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:55.124255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:55.132102 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:55.132593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:55.133031 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:55.133759 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:55.134218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:55.134633 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:55.270247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:55.277796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a6302bb0-3403-4611-8739-2feb37ccc15c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.158126 Sep 28 08:40:55.278353 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 205/381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:55 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:55.887954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:55.888557 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:55.894929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:55.895343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:55.895771 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:55.896454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:55.896897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:55.897342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:56.027527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:56.035621 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:56.037060 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:56.038555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-94c57a18-3ff0-4dc9-a6c9-4a2489e4712c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1407 microversion: 2.20 time: 0.154502 Sep 28 08:40:56.039106 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 177/382] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:55 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:56.299873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:56.300508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:56.306457 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:56.306945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:56.307382 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:56.308075 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:56.308530 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:56.308956 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:56.436098 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:56.444401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2164faa5-632f-4f8b-974d-759f24048b5c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.148441 Sep 28 08:40:56.444959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 206/383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:56 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:57.063767 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:57.064378 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:57.070805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:57.071288 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:57.071727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:57.072419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:57.072871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:57.073321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:57.204806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:57.213550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:57.215007 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:57.216173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8ddcb16a-2048-444d-8a74-406282422386 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1599 microversion: 2.20 time: 0.156382 Sep 28 08:40:57.216731 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 178/384] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:40:57 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:40:57.241650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:57.242141 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:57.248579 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:57.249075 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:57.249841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:57.250247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:57.250699 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:57.251191 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:57.328379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8783dec6-a5fd-41a2-a989-e380ebb286c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090584 Sep 28 08:40:57.329845 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 207/385] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Sep 28 08:40:57 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:40:57.470856 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:57.471475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:57.477941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:57.478449 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:57.478884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:57.479591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:57.480049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:57.480477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:57.717406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:57.726055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-672a78a8-c90e-4603-9437-5ad5781bb61f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.260071 Sep 28 08:40:57.741289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 179/386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:57 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:58.359913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-d09230e3-c0c0-4197-bec9-09ed212464b7 req-588a03ad-d4f7-460e-9b17-a4c9b7bf9cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4", "tag": "34490fea-8100-40b7-919a-078c2cfc5f1d"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:40:58.369362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-d09230e3-c0c0-4197-bec9-09ed212464b7 req-588a03ad-d4f7-460e-9b17-a4c9b7bf9cd8 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:58.369848 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-d09230e3-c0c0-4197-bec9-09ed212464b7 req-588a03ad-d4f7-460e-9b17-a4c9b7bf9cd8 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:58.370459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-d09230e3-c0c0-4197-bec9-09ed212464b7 req-588a03ad-d4f7-460e-9b17-a4c9b7bf9cd8 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:58.382119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-d09230e3-c0c0-4197-bec9-09ed212464b7 req-588a03ad-d4f7-460e-9b17-a4c9b7bf9cd8 service nova] Creating event network-changed:34490fea-8100-40b7-919a-078c2cfc5f1d for instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 on hv-cinder-84456 Sep 28 08:40:58.387401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-d09230e3-c0c0-4197-bec9-09ed212464b7 req-588a03ad-d4f7-460e-9b17-a4c9b7bf9cd8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031146 Sep 28 08:40:58.388114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 208/387] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:40:58.750214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:58.750913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:58.760162 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:58.760738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:58.761283 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:58.762079 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:58.762744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:58.763199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:58.895655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:40:58.903567 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4340f711-e528-4174-8b2b-b7ab6d3d3b0d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.157281 Sep 28 08:40:58.904590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 180/388] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:58 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:40:59.928009 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:40:59.928716 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:40:59.934880 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:59.935363 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:59.935793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:40:59.936484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:40:59.936936 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:40:59.937399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:00.069280 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:00.076751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-760d968d-87e6-4df1-961e-281bff5466ca tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.153172 Sep 28 08:41:00.077327 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 209/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:40:59 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:01.100144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:01.100682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:01.107059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:01.107548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:01.107988 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:01.108683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:01.109199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:01.109631 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:01.236105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:01.243609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-154fcd39-8202-492c-ae98-2336bdce8006 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.147465 Sep 28 08:41:01.244157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 181/390] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:01 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:02.267555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:02.268145 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:02.274290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:02.274779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:02.275220 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:02.275914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:02.276367 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:02.276794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:02.408616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:02.416731 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e5f00509-189a-4e41-bc42-894e771c7471 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.153317 Sep 28 08:41:02.417323 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 210/391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:02 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:03.439646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:03.440247 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:03.446570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:03.447051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:03.447487 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:03.448197 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:03.448648 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:03.449067 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:03.582447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:03.590471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-887ab4eb-358a-4f03-a595-e3cbb88830df tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.155317 Sep 28 08:41:03.591038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 182/392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:03 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:04.613885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:04.614500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:04.620318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:04.620807 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:04.621286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:04.621988 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:04.622443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:04.622906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:04.752133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:04.760377 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8c908c30-440a-4277-ab32-578b657208dd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1509 microversion: 2.1 time: 0.150817 Sep 28 08:41:04.760948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 211/393] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:04 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:05.783454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:05.783988 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:05.790370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:05.790860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:05.791558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:05.792250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:05.792710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:05.793162 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:06.174838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:06.182649 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3938b32e-09d1-4da7-829d-71a2629edb84 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1515 microversion: 2.1 time: 0.403245 Sep 28 08:41:06.183210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 183/394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:05 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:09.674279 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e2730ebe-e358-4514-a74d-7a849a10de30 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'create', calling method: .version_select at 0x7f984fe54790>, body: {"keypair": {"name": "tempest-keypair-823050227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmBbTVabhKBJXO+94rH67RGUf00wZou+vYhowaxk/KM/9J0R8D8XND0GTc0rNP437G2k/t3DFRgfpyUfELLVsXJw/QsV7iuBLppEZnWUNC0SXB/FBUXftFx/TT8WBTOew=="}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:09.691355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-e2730ebe-e358-4514-a74d-7a849a10de30 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for project 42699952850d49fdafb670aeb5f613ed. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:41:09.695725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-e2730ebe-e358-4514-a74d-7a849a10de30 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for user 7d712e201f2c47a8a48b6e24559e0d60 and project 42699952850d49fdafb670aeb5f613ed. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:41:09.717734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e2730ebe-e358-4514-a74d-7a849a10de30 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047775 Sep 28 08:41:09.718328 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 212/395] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:41:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:41:11.064819 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-386830689", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ecfbeafd-1446-46f2-889b-466b351133a2"}], "security_groups": [{"name": "tempest-securitygroup--94570095"}], "key_name": "tempest-keypair-823050227", "user_data": "}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:11.182408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] validate_networks() for [('ecfbeafd-1446-46f2-889b-466b351133a2', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:41:11.582061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:41:11.582490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:41:11.582960 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:41:11.583364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:41:11.583780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:41:11.593563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:11.594051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:11.594490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:11.595233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:11.596405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:11.596838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:11.613765 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for project 42699952850d49fdafb670aeb5f613ed. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:41:11.618083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Getting quotas for user 7d712e201f2c47a8a48b6e24559e0d60 and project 42699952850d49fdafb670aeb5f613ed. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:41:11.629482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:41:11.631856 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:41:11.682356 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0060594d-3f27-4631-a7db-698db3805e12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.622483 Sep 28 08:41:11.683005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 184/396] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:41:11 2022] POST /compute/v2.1/servers => generated 407 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:41:11.694558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-46e8c9d4-f5ab-4597-adaa-ba0ceb0646dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:11.695208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-46e8c9d4-f5ab-4597-adaa-ba0ceb0646dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:11.697157 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:11.772067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-46e8c9d4-f5ab-4597-adaa-ba0ceb0646dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:11.780173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-46e8c9d4-f5ab-4597-adaa-ba0ceb0646dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1244 microversion: 2.1 time: 0.089542 Sep 28 08:41:11.780681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 213/397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:11 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:12.803780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:12.804967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:12.812000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:12.812492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:12.812929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:12.813666 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:12.814997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:12.815374 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:12.886136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:12.895202 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bb7d5b5f-607d-49b8-876a-413620322349 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1296 microversion: 2.1 time: 0.095644 Sep 28 08:41:12.895838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 185/398] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:12 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:13.918958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:13.919592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:13.926888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:13.927387 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:13.927909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:13.928621 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:13.929190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:13.929565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:13.993170 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:14.000761 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-85be3a01-a685-41dc-be58-8479c58b3c55 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1302 microversion: 2.1 time: 0.086045 Sep 28 08:41:14.009190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 214/399] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:13 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:14.903206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-da53db93-6117-4c2e-8569-fef7b9594662 req-2f25c0d3-0edd-4efe-9377-ddae01e32f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde027c2-5ced-4b17-abcd-d13aae06a1aa", "tag": "cd365a60-ac04-41d0-9a07-5370af59c807"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:14.914365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-da53db93-6117-4c2e-8569-fef7b9594662 req-2f25c0d3-0edd-4efe-9377-ddae01e32f93 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:14.914857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-da53db93-6117-4c2e-8569-fef7b9594662 req-2f25c0d3-0edd-4efe-9377-ddae01e32f93 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:14.915294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-da53db93-6117-4c2e-8569-fef7b9594662 req-2f25c0d3-0edd-4efe-9377-ddae01e32f93 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:14.927492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-da53db93-6117-4c2e-8569-fef7b9594662 req-2f25c0d3-0edd-4efe-9377-ddae01e32f93 service nova] Creating event network-changed:cd365a60-ac04-41d0-9a07-5370af59c807 for instance fde027c2-5ced-4b17-abcd-d13aae06a1aa on hv-cinder-84456 Sep 28 08:41:14.933343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-da53db93-6117-4c2e-8569-fef7b9594662 req-2f25c0d3-0edd-4efe-9377-ddae01e32f93 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035067 Sep 28 08:41:14.934261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 186/400] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:41:15.024329 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:15.024944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:15.030916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:15.031405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:15.031846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:15.032543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:15.033002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:15.033454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:15.168635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:15.176517 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-adf6eb35-fa9b-464c-89a7-02c8905c1a75 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.156157 Sep 28 08:41:15.177085 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 215/401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:15 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:15.739083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1604554004", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1228999444", "security_groups": [{"name": "tempest-secgroup-smoke-36982107"}], "networks": [{"uuid": "b76a6eab-b1a4-4566-a068-3e0c81275bca"}], "block_device_mapping_v2": [{"uuid": "36a4e68f-5a7a-4158-a2ba-d4825fb4898f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:15.749309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:15.854775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] validate_networks() for [('b76a6eab-b1a4-4566-a068-3e0c81275bca', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:41:16.201999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:16.203611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:16.214799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:16.215607 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:16.216400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:16.217656 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:16.218532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:16.219332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:16.240578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:41:16.241066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:41:16.241534 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:41:16.241948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:41:16.242364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:41:16.251085 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:16.251572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:16.252007 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:16.252773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:16.253266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:16.253819 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:16.260460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:16.274406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Getting quotas for project c507f95ba3c34cc789ee8903b40c346d. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:41:16.280064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Getting quotas for user 4f250207e16c4515bd9beb9ca4b1fde6 and project c507f95ba3c34cc789ee8903b40c346d. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:41:16.337995 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:41:16.340278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36a4e68f-5a7a-4158-a2ba-d4825fb4898f',volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:41:16.359547 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:16.367242 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3235b13b-f0e2-4e9f-9858-170e66d85861 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.171377 Sep 28 08:41:16.368138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 216/402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:16 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:16.473073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b4d4f920-1772-4893-8826-07aeb8331b76 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.738728 Sep 28 08:41:16.473673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 187/403] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:41:15 2022] POST /compute/v2.1/servers => generated 404 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 08:41:16.484723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-61715c14-1c62-49ee-8715-acab97170809 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:16.485358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-61715c14-1c62-49ee-8715-acab97170809 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:16.540202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-61715c14-1c62-49ee-8715-acab97170809 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:16.547610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-61715c14-1c62-49ee-8715-acab97170809 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1089 microversion: 2.1 time: 0.066670 Sep 28 08:41:16.548173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 217/404] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:16 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:17.391628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:17.392266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:17.398536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:17.399041 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:17.399479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:17.400172 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:17.400641 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:17.401048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:17.534236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:17.542047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5614b0f5-d57e-4d16-b861-c3bc7f8191f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.154738 Sep 28 08:41:17.542609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 188/405] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:17 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:17.570225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:17.570834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:17.576738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:17.577264 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:17.577700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:17.578392 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:17.578846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:17.579271 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:17.639219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:17.647314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fb4eda49-dd35-4652-a793-6dad1b04a8e9 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1139 microversion: 2.1 time: 0.080900 Sep 28 08:41:17.647895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 218/406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:17 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:18.564785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:18.565420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:18.572034 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:18.572528 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:18.572969 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:18.573705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:18.574164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:18.574618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:18.671159 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:18.671895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:18.681569 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:18.682555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:18.683231 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:18.684051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:18.684613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:18.685184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:18.714636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:18.722420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b6465585-b7d9-4bc6-a9be-561c4b629521 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.161473 Sep 28 08:41:18.723352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 189/407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:18 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:18.768791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:18.771230 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:18.778293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f072f933-8b31-40ff-b002-b079c2b8ea3b tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1131 microversion: 2.1 time: 0.111793 Sep 28 08:41:18.778901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 219/408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:18 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1131 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:19.746847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:19.748074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:19.756814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:19.757587 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:19.759153 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:19.760084 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:19.760734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:19.761809 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:19.803569 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:19.804926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:19.812629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:19.813452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:19.814668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:19.815602 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:19.816274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:19.816884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:19.902439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:19.912789 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-38d88f6f-feae-4718-84bf-59ba49d84fbe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1205 microversion: 2.1 time: 0.113162 Sep 28 08:41:19.914546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 220/409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:19 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1205 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:19.941555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:19.949659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-268edbe2-6fac-48d3-9bb2-397ff0e0b1c6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.207600 Sep 28 08:41:19.965470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 190/410] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:19 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:20.941054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:20.941688 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:20.947736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:20.948350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:20.948788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:20.949646 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:20.950102 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:20.950524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:20.972282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:20.973328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:20.979904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:20.991142 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:20.991790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:20.992646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:21.005862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:21.006321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:21.135682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:21.146422 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-405b457c-ed5a-4c6e-a7f2-31b21c49cb5f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.209691 Sep 28 08:41:21.148263 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 221/411] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:20 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:21.178187 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:21.185847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2449a25d-e944-49c2-ac62-7c26b1f11de2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.217484 Sep 28 08:41:21.186414 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 191/412] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:20 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:21.227481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-7610bb18-c735-497a-8386-7cdf4a48cfac req-800daf7d-32c6-4ddf-934b-825aabdc13f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901f2acc-6433-42cb-a931-82ccde824010", "tag": "ed5b6be5-cf6e-47ab-9c77-e942a22429de"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:21.238349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-7610bb18-c735-497a-8386-7cdf4a48cfac req-800daf7d-32c6-4ddf-934b-825aabdc13f1 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:21.238708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-7610bb18-c735-497a-8386-7cdf4a48cfac req-800daf7d-32c6-4ddf-934b-825aabdc13f1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:21.239140 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-7610bb18-c735-497a-8386-7cdf4a48cfac req-800daf7d-32c6-4ddf-934b-825aabdc13f1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:21.251962 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-7610bb18-c735-497a-8386-7cdf4a48cfac req-800daf7d-32c6-4ddf-934b-825aabdc13f1 service nova] Creating event network-changed:ed5b6be5-cf6e-47ab-9c77-e942a22429de for instance 901f2acc-6433-42cb-a931-82ccde824010 on hv-cinder-84456 Sep 28 08:41:21.257197 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-7610bb18-c735-497a-8386-7cdf4a48cfac req-800daf7d-32c6-4ddf-934b-825aabdc13f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033457 Sep 28 08:41:21.257785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 222/413] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:41:21.990620 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-8f897a7d-0069-4b6b-aee3-880701615e79 req-2bdc1fcf-c015-4f67-8659-2f4bce0355cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde027c2-5ced-4b17-abcd-d13aae06a1aa", "name": "network-vif-plugged", "status": "completed", "tag": "cd365a60-ac04-41d0-9a07-5370af59c807"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:22.000570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-8f897a7d-0069-4b6b-aee3-880701615e79 req-2bdc1fcf-c015-4f67-8659-2f4bce0355cf service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:22.001035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-8f897a7d-0069-4b6b-aee3-880701615e79 req-2bdc1fcf-c015-4f67-8659-2f4bce0355cf service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:22.002015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-8f897a7d-0069-4b6b-aee3-880701615e79 req-2bdc1fcf-c015-4f67-8659-2f4bce0355cf service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:22.013003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-8f897a7d-0069-4b6b-aee3-880701615e79 req-2bdc1fcf-c015-4f67-8659-2f4bce0355cf service nova] Creating event network-vif-plugged:cd365a60-ac04-41d0-9a07-5370af59c807 for instance fde027c2-5ced-4b17-abcd-d13aae06a1aa on hv-cinder-84456 Sep 28 08:41:22.018498 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-8f897a7d-0069-4b6b-aee3-880701615e79 req-2bdc1fcf-c015-4f67-8659-2f4bce0355cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Sep 28 08:41:22.019090 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 192/414] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:41:22.171710 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:22.172411 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:22.179014 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:22.179495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:22.179939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:22.180634 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:22.185412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:22.185412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:22.211242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:22.211885 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:22.218213 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:22.218714 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:22.219156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:22.219865 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:22.220342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:22.220995 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:22.374811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:22.383470 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d347b198-5d98-471d-8e3b-14fb7bc744b3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.216115 Sep 28 08:41:22.384035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 223/415] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:22 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:22.403077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:22.410578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9aabe690-ae33-4c54-b5be-363accdf7b12 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.203737 Sep 28 08:41:22.411120 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 193/416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:22 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:23.406495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:23.407111 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:23.413175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:23.413665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:23.414099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:23.414799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:23.415252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:23.415681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:23.435248 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:23.435854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:23.442652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:23.443139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:23.443578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:23.444279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:23.444729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:23.445182 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:23.627898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:23.633568 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:23.636034 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ae01da24-164c-44c3-b636-659b78578c16 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.233395 Sep 28 08:41:23.636827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 224/417] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:23 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:23.641385 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ce199d5a-a146-466f-8e69-45cc0ba35f9f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.209990 Sep 28 08:41:23.642022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 194/418] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:23 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:24.659901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:24.660513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:24.663733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:24.664333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:24.666900 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:24.667344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:24.667777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:24.668520 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:24.668972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:24.669424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:24.672403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:24.672891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:24.673855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:24.674549 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:24.674993 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:24.675417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:24.878607 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:24.882135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:24.886991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-66c933ff-18f5-4117-98e6-90d92245bffe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1368 microversion: 2.1 time: 0.227022 Sep 28 08:41:24.887575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 195/419] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:24 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:24.891114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f99668a8-9ec9-4b04-9155-316ee85f4466 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.235071 Sep 28 08:41:24.891778 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 225/420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:24 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:25.909068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:25.910237 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:25.913811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:25.914662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:25.918210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:25.918708 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:25.919153 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:25.919861 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:25.920315 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:25.920754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:25.921357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:25.922142 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:25.922463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:25.923663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:25.924095 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:25.924568 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:26.119397 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:26.123135 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:26.127763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9687598d-6670-40c9-b909-5dbb56fa686c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.217914 Sep 28 08:41:26.128329 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 226/421] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:25 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:26.131585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-eda2bccb-91d0-498d-858b-9cce6f01f3f1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1562 microversion: 2.1 time: 0.226624 Sep 28 08:41:26.132220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 196/422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:25 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:26.153466 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:26.153960 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:26.160023 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:26.160439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:26.160871 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:26.161595 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:26.162044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:26.162463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:26.241837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-56e67f3c-be97-42cf-b573-6c5423eb1d61 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092219 Sep 28 08:41:26.242427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 227/423] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:41:26 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:41:27.150304 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:27.151169 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:27.153559 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=4 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:27.153983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=12 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:27.163790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:27.163790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:27.163790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:27.163790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:27.164116 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:27.164290 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:27.168969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=8 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:41:27.173869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-da483a7a-45c8-4ed3-989b-b3e8412f792a req-bb1313f8-bf5d-45fe-8ee6-03ec7bde077d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde027c2-5ced-4b17-abcd-d13aae06a1aa", "tag": "cd365a60-ac04-41d0-9a07-5370af59c807"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:27.184452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-da483a7a-45c8-4ed3-989b-b3e8412f792a req-bb1313f8-bf5d-45fe-8ee6-03ec7bde077d service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:27.185024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-da483a7a-45c8-4ed3-989b-b3e8412f792a req-bb1313f8-bf5d-45fe-8ee6-03ec7bde077d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:27.185708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-da483a7a-45c8-4ed3-989b-b3e8412f792a req-bb1313f8-bf5d-45fe-8ee6-03ec7bde077d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:27.197725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-da483a7a-45c8-4ed3-989b-b3e8412f792a req-bb1313f8-bf5d-45fe-8ee6-03ec7bde077d service nova] Creating event network-changed:cd365a60-ac04-41d0-9a07-5370af59c807 for instance fde027c2-5ced-4b17-abcd-d13aae06a1aa on hv-cinder-84456 Sep 28 08:41:27.207438 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-da483a7a-45c8-4ed3-989b-b3e8412f792a req-bb1313f8-bf5d-45fe-8ee6-03ec7bde077d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039341 Sep 28 08:41:27.208287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 228/424] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:41:27.302184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:27.311320 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-29fb1b8c-6eef-4eb2-8586-f2f866da6ef2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.164934 Sep 28 08:41:27.311981 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 197/425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:27 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:41:28.336095 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:28.336758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:28.343116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:28.343601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:28.344040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:28.344765 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:28.345797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:28.346255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:28.483281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:28.491516 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-03a1070b-4013-4097-be5e-f335e35700fa tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.159969 Sep 28 08:41:28.492182 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 229/426] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:28 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:29.514591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:29.515312 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:29.522000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:29.522494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:29.522935 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:29.523644 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:29.524130 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:29.524564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:29.656779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:29.665161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2d186ab9-d916-49db-833d-b3cb03c5df52 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.154550 Sep 28 08:41:29.665724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 198/427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:29 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:30.688173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:30.689356 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:30.695338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:30.695822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:30.696264 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:30.696952 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:30.697435 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:30.697863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:31.084061 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:31.091791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2fcde7a1-1251-4d3e-be9f-4e2ea8d0ace3 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.407503 Sep 28 08:41:31.092359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 230/428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:30 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:32.113949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:32.114551 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:32.120997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:32.121517 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:32.121964 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:32.122654 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:32.123110 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:32.123539 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:32.256524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:32.264253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6000d4b8-18fb-4a0d-9187-b2a36b671f34 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.154270 Sep 28 08:41:32.264804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 199/429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:32 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:33.287783 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:33.288432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:33.294918 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:33.295408 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:33.295848 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:33.296543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:33.297029 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:33.297488 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:33.428983 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:33.436590 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cecf8823-411b-4879-861b-e6ecc3b7e3dd tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.152769 Sep 28 08:41:33.437248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 231/430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:33 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:34.272980 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-a6fcb01d-5e48-438d-89cf-739cb0c2c4e8 req-04989a06-fa37-44bc-87fe-53b5c0a11b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901f2acc-6433-42cb-a931-82ccde824010", "name": "network-vif-plugged", "status": "completed", "tag": "ed5b6be5-cf6e-47ab-9c77-e942a22429de"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:34.283349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-a6fcb01d-5e48-438d-89cf-739cb0c2c4e8 req-04989a06-fa37-44bc-87fe-53b5c0a11b1e service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:34.283833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-a6fcb01d-5e48-438d-89cf-739cb0c2c4e8 req-04989a06-fa37-44bc-87fe-53b5c0a11b1e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:34.284268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-a6fcb01d-5e48-438d-89cf-739cb0c2c4e8 req-04989a06-fa37-44bc-87fe-53b5c0a11b1e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:34.295655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-a6fcb01d-5e48-438d-89cf-739cb0c2c4e8 req-04989a06-fa37-44bc-87fe-53b5c0a11b1e service nova] Creating event network-vif-plugged:ed5b6be5-cf6e-47ab-9c77-e942a22429de for instance 901f2acc-6433-42cb-a931-82ccde824010 on hv-cinder-84456 Sep 28 08:41:34.301284 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-a6fcb01d-5e48-438d-89cf-739cb0c2c4e8 req-04989a06-fa37-44bc-87fe-53b5c0a11b1e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032052 Sep 28 08:41:34.302059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 200/431] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:41:34.459807 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:34.460422 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:34.467650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:34.468143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:34.468572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:34.469321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:34.469776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:34.470710 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:34.603250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:34.611901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-37fc80a4-5bdd-4368-be73-24b4241ce794 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.156408 Sep 28 08:41:34.612702 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 232/432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:34 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:35.635742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:35.636368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:35.642439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:35.642931 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:35.643367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:35.644056 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:35.644515 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:35.644940 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:35.778879 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:35.786494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c418ba2a-7dbb-44f9-83b3-f103805ddafc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.155561 Sep 28 08:41:35.787079 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 201/433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:35 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:36.809752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:36.810313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:36.817247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:36.817735 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:36.818170 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:36.818889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:36.819344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:36.819763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:36.948914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:36.957229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7df363dc-bc8f-4be7-a5b3-4976615162c2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1259 microversion: 2.1 time: 0.151350 Sep 28 08:41:36.958015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 233/434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:36 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:37.980179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:37.980795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:37.987599 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:37.988085 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:37.988525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:37.989293 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:37.989752 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:37.990179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:38.129376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:38.137648 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b61a569d-6f1b-47c1-8e53-e0767dc369b4 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1441 microversion: 2.1 time: 0.161494 Sep 28 08:41:38.138224 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 202/435] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:37 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1441 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:38.161114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:41:38.161756 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:41:38.168198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:38.168686 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:38.169150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:38.169853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:38.170311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:38.170734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:38.311780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:41:38.320465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a9d214a7-143f-41cf-8a78-671aa567b4af tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1441 microversion: 2.1 time: 0.163294 Sep 28 08:41:38.321037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 234/436] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:41:38 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1441 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:41:40.201645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-d30a2596-e1bf-4f20-a875-84167051abc8 req-12612dde-9c3f-41d2-984c-02da8da8e6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901f2acc-6433-42cb-a931-82ccde824010", "tag": "ed5b6be5-cf6e-47ab-9c77-e942a22429de"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:41:40.222063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-d30a2596-e1bf-4f20-a875-84167051abc8 req-12612dde-9c3f-41d2-984c-02da8da8e6e1 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:41:40.222834 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-d30a2596-e1bf-4f20-a875-84167051abc8 req-12612dde-9c3f-41d2-984c-02da8da8e6e1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:41:40.223566 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-d30a2596-e1bf-4f20-a875-84167051abc8 req-12612dde-9c3f-41d2-984c-02da8da8e6e1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:41:40.243559 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-d30a2596-e1bf-4f20-a875-84167051abc8 req-12612dde-9c3f-41d2-984c-02da8da8e6e1 service nova] Creating event network-changed:ed5b6be5-cf6e-47ab-9c77-e942a22429de for instance 901f2acc-6433-42cb-a931-82ccde824010 on hv-cinder-84456 Sep 28 08:41:40.251200 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-d30a2596-e1bf-4f20-a875-84167051abc8 req-12612dde-9c3f-41d2-984c-02da8da8e6e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056208 Sep 28 08:41:40.252029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 203/437] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:42:10.894719 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:10.895277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:10.897569 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 28 08:42:10.898411 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=47 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:10.899066 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=81 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:10.905982 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:10.906467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:10.906905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:10.907603 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:10.908059 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:10.908486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:10.932695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fefdb4b2-ebb5-4e30-b7d8-9b3bcec9ac0c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/ips" status: 200 len: 149 microversion: 2.1 time: 0.041901 Sep 28 08:42:10.933304 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 235/438] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:42:10 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:11.846918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:11.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=84 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:11.852681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:11.853312 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:11.861130 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:11.861626 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:11.862068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:11.862793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:11.863308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:11.863693 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:11.886899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6078a1fa-343e-4752-a11f-9a455fbd7354 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/ips" status: 200 len: 146 microversion: 2.1 time: 0.041846 Sep 28 08:42:11.887459 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 204/439] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:42:11 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:13.357119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aa6261b-8d3f-4a84-b301-547902f792c6"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:13.359697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:13.365611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:13.366097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:13.366537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:13.367228 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:13.367682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:13.368109 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:13.666787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7be46e47-5e2e-4307-aa71-d73c1fa9d100 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313473 Sep 28 08:42:13.667652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 236/440] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:42:13 2022] POST /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:13.960003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b021f4ff-da71-44dd-8490-832857972e07"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:13.962355 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:13.968572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:13.969055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:13.969531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:13.970215 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:13.970668 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:13.971091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:14.249512 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fdb5f919-caef-4c65-a315-065805a54629 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293190 Sep 28 08:42:14.250164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 205/441] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:42:13 2022] POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:21.206261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-72e449d5-26c5-4f00-a9e0-e7aaa52b453f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: .version_select at 0x7f984fd6d700>, body: {"keypair": {"name": "tempest-keypair-1248158950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0rll50OhhMe7x3UMdTK7VJ1F0x9k1gBvZ7Ox1BHobR2nPFj4LW2VhkVa8Ll1eUsyV+OriHZKXaR/lXxo5YwR1MTMqzxyfx83biRxPIgvpP+qJfhqZUe3kFb1Lm01sxgg=="}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:21.223207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-72e449d5-26c5-4f00-a9e0-e7aaa52b453f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:42:21.227635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-72e449d5-26c5-4f00-a9e0-e7aaa52b453f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:42:21.249366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-72e449d5-26c5-4f00-a9e0-e7aaa52b453f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049014 Sep 28 08:42:21.249959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 237/442] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:42:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:22.526941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1958651235", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5328add-2390-4470-bd9d-0ff97db6e42c"}], "security_groups": [{"name": "tempest-securitygroup--463917979"}], "key_name": "tempest-keypair-1248158950", "user_data": "}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:22.632073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] validate_networks() for [('b5328add-2390-4470-bd9d-0ff97db6e42c', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:42:23.008701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:42:23.009350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:42:23.010034 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:42:23.010640 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:42:23.011253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:42:23.021157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:23.021921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:23.022553 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:23.023659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:23.024366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:23.024987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:23.042678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:42:23.046602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:42:23.058332 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:42:23.060715 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:42:23.107608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4d3e58c0-2768-4597-a9d7-fc4f6d22d37f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.586631 Sep 28 08:42:23.108246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 206/443] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:42:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:42:23.120659 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2dd227bb-6190-4cec-a85f-9ba4bb32d0fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:23.121424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2dd227bb-6190-4cec-a85f-9ba4bb32d0fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:23.175977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2dd227bb-6190-4cec-a85f-9ba4bb32d0fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:23.183596 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2dd227bb-6190-4cec-a85f-9ba4bb32d0fb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1242 microversion: 2.1 time: 0.067821 Sep 28 08:42:23.184168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 238/444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:23 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:24.207152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:24.207758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:24.215363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:24.215855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:24.216296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:24.216986 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:24.217470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:24.217897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:24.284233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:24.292253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-087b56fb-2e59-46e6-a44a-ba9beae99909 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1294 microversion: 2.1 time: 0.089661 Sep 28 08:42:24.292979 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 207/445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:24 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:25.316641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:25.317305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:25.319818 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:25.327348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:25.327853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:25.328297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:25.329018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:25.329500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:25.330131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:25.474532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:25.483552 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2cb4243f-0c52-4695-9754-5b25f8402588 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.171492 Sep 28 08:42:25.484299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 239/446] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:25 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:25.988565 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-ae3935ee-9dc6-454b-8cce-a77e7a136290 req-2169d9d8-c4ac-43b9-86f4-b646e5a60a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489154e1-8189-48c2-9b84-b7f0c34221ee", "tag": "93ce9123-1418-4ef6-bd1c-914373525bb5"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:25.999805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-ae3935ee-9dc6-454b-8cce-a77e7a136290 req-2169d9d8-c4ac-43b9-86f4-b646e5a60a51 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:26.000285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-ae3935ee-9dc6-454b-8cce-a77e7a136290 req-2169d9d8-c4ac-43b9-86f4-b646e5a60a51 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:26.000786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-ae3935ee-9dc6-454b-8cce-a77e7a136290 req-2169d9d8-c4ac-43b9-86f4-b646e5a60a51 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:26.014129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-ae3935ee-9dc6-454b-8cce-a77e7a136290 req-2169d9d8-c4ac-43b9-86f4-b646e5a60a51 service nova] Creating event network-changed:93ce9123-1418-4ef6-bd1c-914373525bb5 for instance 489154e1-8189-48c2-9b84-b7f0c34221ee on hv-cinder-84456 Sep 28 08:42:26.019634 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-ae3935ee-9dc6-454b-8cce-a77e7a136290 req-2169d9d8-c4ac-43b9-86f4-b646e5a60a51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035243 Sep 28 08:42:26.020438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 208/447] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:26.506437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:26.507045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:26.513978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:26.514456 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:26.514886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:26.515576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:26.516018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:26.516436 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:26.647551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:26.655509 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8a84d1e1-6ebe-4280-8978-98a23c0381f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.152806 Sep 28 08:42:26.655999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 240/448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:26 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:27.678806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:27.679505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:27.686184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:27.686674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:27.687111 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:27.687814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:27.688273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:27.688701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:27.819086 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:27.827141 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9a48fd88-385b-4e96-ac31-c2740d64f022 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.152599 Sep 28 08:42:27.827701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 209/449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:27 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:28.850340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:28.850990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:28.858275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:28.858757 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:28.859196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:28.859886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:28.860346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:28.860767 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:28.990025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:28.997635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-123f7d46-86c9-419d-84ff-293c84a4ebf1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.151266 Sep 28 08:42:28.998199 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 241/450] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:28 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:30.020980 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:30.021625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:30.028534 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:30.028813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:30.029286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:30.029983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:30.030439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:30.030867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:30.160595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:30.168678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3c306352-4b5e-4fe4-982a-de3307f2ac61 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.151666 Sep 28 08:42:30.169267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 210/451] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:30 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:31.191913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:31.193598 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:31.201317 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:31.202211 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:31.202869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:31.203900 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:31.204425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:31.204842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:31.348777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:31.349219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-43d450bb-528a-44d2-b3c5-6e9f8f210b6a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:31.357151 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-43d450bb-528a-44d2-b3c5-6e9f8f210b6a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:31.357519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-828d07a6-2d02-45c2-b23d-747e8e4a997e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.169556 Sep 28 08:42:31.357647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-43d450bb-528a-44d2-b3c5-6e9f8f210b6a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:31.358083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-43d450bb-528a-44d2-b3c5-6e9f8f210b6a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:31.358218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 242/452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:31 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:31.423066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-43d450bb-528a-44d2-b3c5-6e9f8f210b6a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Going to try to stop instance {{(pid=127110) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 08:42:31.469140 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-43d450bb-528a-44d2-b3c5-6e9f8f210b6a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.123758 Sep 28 08:42:31.469775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 211/453] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:42:31 2022] POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:42:31.478048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:31.478658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:31.484878 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:31.485392 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:31.485824 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:31.486649 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:31.487144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:31.487351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:31.618068 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:31.626233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-86223604-e960-4eda-bbd0-3fc743aed6bb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.152263 Sep 28 08:42:31.626809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 243/454] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:31 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:32.382468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:32.383160 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:32.389205 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:32.389690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:32.390124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:32.390842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:32.391299 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:32.391723 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:32.524708 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:32.532572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a2e15f0e-e848-4767-a938-3f5ac3bfa4ed tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.155015 Sep 28 08:42:32.533209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 212/455] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:32 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:32.606947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-0b9e0005-f963-4625-aedf-a9240970de82 req-d567177d-8095-4541-a679-0e416ec5af96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489154e1-8189-48c2-9b84-b7f0c34221ee", "name": "network-vif-plugged", "status": "completed", "tag": "93ce9123-1418-4ef6-bd1c-914373525bb5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:32.617485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0b9e0005-f963-4625-aedf-a9240970de82 req-d567177d-8095-4541-a679-0e416ec5af96 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:32.617969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0b9e0005-f963-4625-aedf-a9240970de82 req-d567177d-8095-4541-a679-0e416ec5af96 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:32.618397 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0b9e0005-f963-4625-aedf-a9240970de82 req-d567177d-8095-4541-a679-0e416ec5af96 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:32.630075 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-0b9e0005-f963-4625-aedf-a9240970de82 req-d567177d-8095-4541-a679-0e416ec5af96 service nova] Creating event network-vif-plugged:93ce9123-1418-4ef6-bd1c-914373525bb5 for instance 489154e1-8189-48c2-9b84-b7f0c34221ee on hv-cinder-84456 Sep 28 08:42:32.635109 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-0b9e0005-f963-4625-aedf-a9240970de82 req-d567177d-8095-4541-a679-0e416ec5af96 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031836 Sep 28 08:42:32.635682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 244/456] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:32.650453 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:32.651095 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:32.656932 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:32.657452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:32.657884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:32.658598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:32.659050 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:32.659470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:32.791652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:32.799948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e0f3f2da-e972-4fb7-8df3-eb02414aab42 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.154011 Sep 28 08:42:32.800510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 213/457] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:32 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:33.553080 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:33.557961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:33.558657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:33.565030 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:33.565538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:33.565973 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:33.566656 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:33.567107 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:33.567527 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:33.700141 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:33.707804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6d6df4d5-8ac4-495b-8c61-f1876706733a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.155680 Sep 28 08:42:33.708357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 245/458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:33 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:33.823097 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:33.823795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:33.825820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:33.826652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:33.833359 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:33.833880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:33.834320 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:33.835022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:33.835479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:33.835914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:33.961635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:33.969810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c89394f1-a7aa-4301-aad0-d7f38a656e05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.150714 Sep 28 08:42:33.970381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 214/459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:33 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:34.730330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:34.730975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:34.737393 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:34.737879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:34.738316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:34.739015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:34.739469 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:34.739898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:34.872349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:34.880021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f01aee3f-1d40-451c-86a3-779797903e10 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1367 microversion: 2.1 time: 0.153634 Sep 28 08:42:34.880589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 246/460] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:34 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:34.993388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:34.994002 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:35.000395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:35.000883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:35.001364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:35.002062 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:35.002521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:35.002945 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:35.131415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:35.139696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1b64a089-20c2-4e67-8632-57339a253f5b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.150946 Sep 28 08:42:35.140308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 215/461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:34 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:35.903828 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:35.904443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:35.910904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:35.911401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:35.911823 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:35.912513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:35.912966 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:35.913443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:36.041519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:36.049450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-aee061a6-6465-47d5-89fb-30c12fc31873 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1556 microversion: 2.1 time: 0.149456 Sep 28 08:42:36.050014 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 247/462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:35 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:36.071808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:36.072327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:36.078610 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:36.079091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:36.079522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:36.080204 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:36.080650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:36.081076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:36.163953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:36.164497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:36.169586 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f3f8de04-cfb2-4c45-bae7-d487a5ec13f9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102038 Sep 28 08:42:36.170243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 216/463] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:42:36 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:36.170811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:36.171295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:36.171729 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:36.172419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:36.172860 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:36.173311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:36.688857 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:36.697039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b1becd68-fac6-471d-8039-a81924653b6e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.537057 Sep 28 08:42:36.697828 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 248/464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:36 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:42:37.401880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-59012d91-c96e-4ca3-ab44-266fb5946857 req-759a72f6-1d69-45b4-bced-6416d2247d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489154e1-8189-48c2-9b84-b7f0c34221ee", "tag": "93ce9123-1418-4ef6-bd1c-914373525bb5"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:37.411305 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-59012d91-c96e-4ca3-ab44-266fb5946857 req-759a72f6-1d69-45b4-bced-6416d2247d39 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:37.411788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-59012d91-c96e-4ca3-ab44-266fb5946857 req-759a72f6-1d69-45b4-bced-6416d2247d39 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:37.412219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-59012d91-c96e-4ca3-ab44-266fb5946857 req-759a72f6-1d69-45b4-bced-6416d2247d39 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:37.423885 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-59012d91-c96e-4ca3-ab44-266fb5946857 req-759a72f6-1d69-45b4-bced-6416d2247d39 service nova] Creating event network-changed:93ce9123-1418-4ef6-bd1c-914373525bb5 for instance 489154e1-8189-48c2-9b84-b7f0c34221ee on hv-cinder-84456 Sep 28 08:42:37.429669 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-59012d91-c96e-4ca3-ab44-266fb5946857 req-759a72f6-1d69-45b4-bced-6416d2247d39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032377 Sep 28 08:42:37.430371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 217/465] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:42:37.720027 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:37.720883 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:37.726944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:37.727630 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:37.728070 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:37.728764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:37.729439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:37.729866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:37.876186 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:37.887072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9e99188f-8a9d-41d9-8d79-a30a09ffa443 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.171136 Sep 28 08:42:37.893679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 249/466] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:37 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:38.912235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:38.912946 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:38.919751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:38.920290 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:38.920773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:38.921605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:38.922165 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:38.922665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:39.056124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:39.065473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c7ff604c-5bd5-4005-b583-020cc96cdde1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.157395 Sep 28 08:42:39.066039 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 218/467] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:38 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:40.089714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:40.090321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:40.096696 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:40.097221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:40.097692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:40.098390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:40.098845 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:40.099272 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:40.231359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:40.239501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ce197a9b-f15d-4837-a144-8b4ab3df1596 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.154130 Sep 28 08:42:40.240060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 250/468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:40 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:41.262920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:41.263544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:41.270267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:41.270757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:41.271199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:41.271906 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:41.272359 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:41.272791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:41.400697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:41.409970 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f3a4a309-6661-4b4f-b548-bae44c8a7cbd tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.151238 Sep 28 08:42:41.410895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 219/469] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:41 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:42.434895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:42.435534 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:42.437888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:42.444192 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:42.444782 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:42.445723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:42.446427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:42.446876 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:42.447298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:42.583249 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:42.591418 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6a2620a0-767f-4e56-9272-e68af94ce0fe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.160420 Sep 28 08:42:42.591977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 251/470] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:42 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:43.615019 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:43.615621 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:43.618146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:43.623554 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:43.624039 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:43.624472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:43.625192 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:43.625668 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:43.626088 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:43.630705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:43.736415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:43.737003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:43.743760 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:43.744264 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:43.744702 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:43.745464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:43.745931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:43.746359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:43.764199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:43.780486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2cbd560c-ad12-44ed-83ee-7b0076f12aa4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/ips" status: 200 len: 152 microversion: 2.20 time: 0.048109 Sep 28 08:42:43.781262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 252/471] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Sep 28 08:42:43 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 08:42:43.783744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1d25aaf3-1792-4113-b5aa-36823792f447 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.172503 Sep 28 08:42:43.784513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 220/472] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:43 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:44.810723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:44.811329 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:44.817752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:44.818450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:44.818674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:44.819365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:44.820300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:44.820728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:44.957315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:44.965846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4df62386-1838-4be1-8de1-bd1ce8365e5c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.158972 Sep 28 08:42:44.966395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 253/473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:44 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:45.988584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:45.989217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:45.995726 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:45.996214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:45.996652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:45.997441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:45.997905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:45.998343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:46.127137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:46.136091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ac852423-5fcd-446d-8259-4065eb9f0958 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.151418 Sep 28 08:42:46.136653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 221/474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:45 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:46.224949 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:46.225538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:46.231890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:46.232371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:46.232809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:46.233540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:46.233997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:46.234450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:46.256859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lazy-loading 'flavor' on Instance uuid 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:42:46.313788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:42:46.446526 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f89bffb1-5d59-4538-9308-21ad9c79e994 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/action" status: 202 len: 0 microversion: 2.20 time: 0.225337 Sep 28 08:42:46.447162 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 254/475] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 08:42:46 2022] POST /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:42:46.456841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:46.457504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:46.463904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:46.464451 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:46.464972 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:46.465816 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:46.466282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:46.466720 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:46.600576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:46.609270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:46.610727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:46.611888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6161b724-5dc6-4ce4-b5ef-cb3ec62a8c5c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.159174 Sep 28 08:42:46.612452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 222/476] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:46 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:47.160698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:47.161412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:47.167622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:47.168351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:47.168779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:47.169484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:47.169929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:47.170344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:47.302278 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:47.310414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a250aace-a98a-4546-9e9a-34bca181eda4 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.154009 Sep 28 08:42:47.310970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 255/477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:47 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:47.638372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:47.638988 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:47.645463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:47.645951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:47.646387 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:47.647089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:47.647543 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:47.647967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:47.776121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:47.784105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:47.785576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:47.786761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b115de43-3f2f-4d34-91b0-c8c5d1dd0e1d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.152441 Sep 28 08:42:47.787354 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 223/478] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:47 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:48.334129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:48.334662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:48.341609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:48.342089 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:48.342523 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:48.343211 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:48.343663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:48.344084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:48.474276 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:48.483042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-161fb4e2-1f0f-46bc-976e-dd28622cbb11 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.152894 Sep 28 08:42:48.483604 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 256/479] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:48 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:48.813063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:48.813719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:48.820609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:48.821105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:48.821558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:48.822247 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:48.822700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:48.823129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:48.947949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:48.956183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:48.957691 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:48.958858 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d6141a5e-fcd5-494a-ac80-d97efb6a1aa3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.149735 Sep 28 08:42:48.959418 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 224/480] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:48 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:49.506217 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:49.506869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:49.513181 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:49.513673 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:49.514116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:49.514845 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:49.515310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:49.515748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:49.648454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:49.656628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bb7978a5-61e6-4e57-9ad7-26fa3b75fcdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.154259 Sep 28 08:42:49.657144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 257/481] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:49 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:49.984032 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:49.984637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:49.991012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:49.991493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:49.991920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:49.992603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:49.993052 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:49.993613 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:50.124437 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:50.133015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:50.134504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:50.135664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c47a3342-76da-4865-bb7e-19ff076de27c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.155521 Sep 28 08:42:50.136228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 225/482] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:49 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:50.681893 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:50.682497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:50.688889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:50.689409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:50.689851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:50.690542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:50.690998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:50.691429 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:50.818480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:50.827339 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1bde5a3e-6a7a-4d47-8279-d68d5580e2e5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.149982 Sep 28 08:42:50.827910 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 258/483] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:50 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:51.161375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:51.161893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:51.169061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:51.169576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:51.170011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:51.170699 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:51.171158 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:51.171586 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:51.305916 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:51.314124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:51.315578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:51.316746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c472a5b2-327d-4d47-97ab-c682d1cdd28a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.159423 Sep 28 08:42:51.317341 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 226/484] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:51 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:51.850836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:51.851498 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:51.857914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:51.858394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:51.858835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:51.859519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:51.859972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:51.860393 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:51.989256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:51.997810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8f705f52-6561-4a80-83c1-fcea501e3366 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1723 microversion: 2.1 time: 0.150936 Sep 28 08:42:51.998376 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 259/485] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:51 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:52.341922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:52.342570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:52.348838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:52.349357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:52.349798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:52.350487 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:52.350941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:52.351364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:52.483779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:52.491835 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:52.493921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:52.495100 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-340aee3f-1bfb-477c-9fbf-f06c606087e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.157136 Sep 28 08:42:52.495653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 227/486] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:52 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:53.022054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:53.022667 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:53.030163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:53.030658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:53.031104 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:53.031822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:53.032280 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:53.032704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:53.164586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:53.173256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3999fcec-a407-485c-8006-87b3c4e7f1f7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1700 microversion: 2.1 time: 0.155071 Sep 28 08:42:53.173825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 260/487] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:53 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:53.195593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a2d992bd-8d48-416e-b13d-3824ea947323 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:42:53.202109 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2d992bd-8d48-416e-b13d-3824ea947323 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:53.202593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2d992bd-8d48-416e-b13d-3824ea947323 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:53.203025 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2d992bd-8d48-416e-b13d-3824ea947323 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:53.226839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a2d992bd-8d48-416e-b13d-3824ea947323 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Going to try to start instance {{(pid=127110) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 08:42:53.269865 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a2d992bd-8d48-416e-b13d-3824ea947323 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.077892 Sep 28 08:42:53.270469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 228/488] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:42:53 2022] POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:42:53.279754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:53.280282 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:53.286544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:53.287136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:53.287480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:53.288165 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:53.288616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:53.289037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:53.428920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:53.437997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5cc60779-41bf-4899-a70a-0ca3a7b5f219 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1709 microversion: 2.1 time: 0.162145 Sep 28 08:42:53.438578 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 261/489] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:53 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:53.523983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:53.525012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:53.531769 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:53.532220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:53.532660 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:53.533431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:53.533895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:53.534320 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:53.669064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:53.677320 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:53.678780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:53.680020 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f66aeaa0-1238-42a5-8d77-01013ae947e7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.161027 Sep 28 08:42:53.681150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 229/490] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:53 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:54.461274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:54.461919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:54.468405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:54.468935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:54.469357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:54.470095 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:54.470549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:54.470977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:54.604863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:54.613060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ffbd2e8b-88e2-4b3c-9263-9a04916c6c5f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1709 microversion: 2.1 time: 0.155663 Sep 28 08:42:54.613646 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 262/491] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:54 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:54.705823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:54.706426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:54.712696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:54.713229 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:54.713667 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:54.714356 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:54.714808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:54.715233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:54.847088 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:54.856684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:54.858651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:54.859847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4b4b7e3b-97df-4c6d-8653-5615a8f68f84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.157968 Sep 28 08:42:54.860454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 230/492] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:54 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:55.637985 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:55.638629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:55.645176 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:55.645669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:55.646110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:55.646803 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:55.647261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:55.647709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:55.776531 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:55.784800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-13109af9-4fa7-4602-9a49-e7ecc3e6e92b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1713 microversion: 2.1 time: 0.151227 Sep 28 08:42:55.785482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 263/493] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:42:55 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:42:55.886381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:55.887022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:55.893522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:55.894012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:55.894454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:55.895160 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:55.895617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:55.896046 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:56.024878 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:56.033075 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:56.034684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:56.035846 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-aafe2946-b848-4b22-a1d4-1f63b3f9cc7f tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.154049 Sep 28 08:42:56.036402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 231/494] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:55 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:57.062562 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:57.063256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:57.070359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:57.071389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:57.071832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:57.072563 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:57.073021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:57.073494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:57.319316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:57.327844 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:57.329312 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:57.330502 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d2423d71-5023-47e4-942f-52d6e5d0a2e6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.272062 Sep 28 08:42:57.331049 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 264/495] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:57 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:58.355745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:58.356389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:58.362770 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:58.363258 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:58.363702 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:58.364395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:58.364853 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:58.365317 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:58.551134 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:58.559919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:58.561397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:58.562565 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-85ae8f49-cf51-47f5-b387-b065d5186676 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.210723 Sep 28 08:42:58.563119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 232/496] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:58 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:42:59.588510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:42:59.589129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:42:59.595625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:59.596112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:59.596546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:59.597270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:42:59.597725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:42:59.598144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:42:59.730834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:59.739119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:59.740571 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:42:59.741758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-61936a63-9a56-4fb9-a4aa-2571c61c0628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1745 microversion: 2.20 time: 0.157748 Sep 28 08:42:59.742573 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 265/497] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:42:59 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:00.767838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:00.768504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:00.774902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:00.775320 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:00.776321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:00.777037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:00.777641 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:00.778068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:00.920016 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:00.930300 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:00.932759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:00.934536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f913d74a-5add-40e1-ae30-dc52ef0f79c3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1745 microversion: 2.20 time: 0.170356 Sep 28 08:43:00.935080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 233/498] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:00 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:01.959682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:01.960290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:01.966723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:01.967211 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:01.967651 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:01.968344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:01.968799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:01.969257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:02.099199 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:02.107758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:02.109246 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:02.110405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4f872294-c967-4406-8e34-aebd378f11ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1745 microversion: 2.20 time: 0.154630 Sep 28 08:43:02.110962 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 266/499] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:01 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:02.681874 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-daf8dfee-fc5b-464f-ae2d-81d5b0386ab3 req-5fcdf31f-9533-48b7-b8dd-32a43f6c8efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4", "name": "network-vif-plugged", "status": "completed", "tag": "34490fea-8100-40b7-919a-078c2cfc5f1d"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:02.692471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-daf8dfee-fc5b-464f-ae2d-81d5b0386ab3 req-5fcdf31f-9533-48b7-b8dd-32a43f6c8efb service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:02.693038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-daf8dfee-fc5b-464f-ae2d-81d5b0386ab3 req-5fcdf31f-9533-48b7-b8dd-32a43f6c8efb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:02.693490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-daf8dfee-fc5b-464f-ae2d-81d5b0386ab3 req-5fcdf31f-9533-48b7-b8dd-32a43f6c8efb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:02.705407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-daf8dfee-fc5b-464f-ae2d-81d5b0386ab3 req-5fcdf31f-9533-48b7-b8dd-32a43f6c8efb service nova] Creating event network-vif-plugged:34490fea-8100-40b7-919a-078c2cfc5f1d for instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 on hv-cinder-84456 Sep 28 08:43:02.710717 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-daf8dfee-fc5b-464f-ae2d-81d5b0386ab3 req-5fcdf31f-9533-48b7-b8dd-32a43f6c8efb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032829 Sep 28 08:43:02.711458 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 234/500] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:43:03.136684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:03.137316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:03.143781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:03.144260 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:03.144688 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:03.145477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:03.145931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:03.146351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:03.272940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:03.280969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:03.282439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:03.283588 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-507e340b-b1fd-4399-8eb3-47e245cbc87c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1745 microversion: 2.20 time: 0.151469 Sep 28 08:43:03.284135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 267/501] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:03 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:04.309127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:04.309844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:04.315978 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:04.316461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:04.316896 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:04.317622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:04.318077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:04.318501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:04.449660 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:04.457608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:04.459034 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:04.460173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-49294269-593c-42b3-aebd-30ae762f88a4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1745 microversion: 2.20 time: 0.155846 Sep 28 08:43:04.460718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 235/502] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:04 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:05.486252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:05.486802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:05.493259 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:05.493752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:05.494184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:05.494873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:05.495321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:05.495743 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:05.625744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:05.633783 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:05.635240 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:05.636394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cd30e023-2b36-450b-aa5d-8b3a0b2a23b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1745 microversion: 2.20 time: 0.154213 Sep 28 08:43:05.636953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 268/503] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:05 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:06.661431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:06.662064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:06.669353 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:06.669841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:06.670274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:06.671046 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:06.671499 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:06.671921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:06.687554 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:06.805209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:06.813754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:06.815221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:06.816389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6fc6dd15-14de-453d-aff7-27ca5e1e08f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1745 microversion: 2.20 time: 0.158951 Sep 28 08:43:06.816994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 236/504] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:06 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:07.841671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:07.843448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:07.853070 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:07.854252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:07.856058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:07.857433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:07.858386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:07.858978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:08.037573 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:08.047750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:08.049773 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:08.051333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3ca52dee-bb90-47ef-a2e4-e9220286bf9a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.213937 Sep 28 08:43:08.051970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 269/505] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:07 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:09.078556 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:09.079167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:09.085777 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:09.086516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:09.086955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:09.087721 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:09.088109 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:09.089066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:09.226950 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:09.235341 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:09.236793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:09.238275 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fff55eb1-42ec-405d-974c-9d9f54fc6b93 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.163504 Sep 28 08:43:09.239510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 237/506] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:09 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:09.904472 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd8eeb76-0b57-4d24-ae2e-0e50ab1fa350"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:09.908569 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:09.915514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:09.916002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:09.916994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:09.917724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:09.918433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:09.918859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:10.092038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:10.236175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1c1ffd0e-7415-40ac-a0de-6a7b93c6d4c3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344945 Sep 28 08:43:10.236961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 270/507] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:43:09 2022] POST /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:43:10.265380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:10.266265 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:10.283900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:10.284424 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:10.287475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:10.291829 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:10.292593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:10.293447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:10.447133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:10.458530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:10.460635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:10.461937 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d8003c25-5914-4938-ab39-66c6b1066d2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.201973 Sep 28 08:43:10.481722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 238/508] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:10 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:11.491872 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:11.492797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:11.498866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:11.499354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:11.499792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:11.500486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:11.500939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:11.501394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:11.646081 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:11.654975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:11.656445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:11.657647 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-586acf95-9b9e-48a5-bd31-71363e51c11e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.170527 Sep 28 08:43:11.658247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 271/509] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:11 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:12.684188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:12.684847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:12.691262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:12.691749 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:12.692189 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:12.692889 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:12.693375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:12.693803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:12.840361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:12.848475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:12.849951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:12.851132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-823e98c9-1405-47a8-8be9-f19d9762d308 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.171327 Sep 28 08:43:12.851677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 239/510] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:12 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:13.884336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:13.885504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:13.888251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=42 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:13.893924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:13.894503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:13.895033 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:13.895826 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:13.896357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:13.896832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:14.056802 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:14.068267 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:14.074024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:14.082002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f5d27e6b-bda9-497c-848b-d5140f5c1896 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.196195 Sep 28 08:43:14.086668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 272/511] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:13 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:15.112524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:15.113228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:15.116790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=40 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:15.121872 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:15.122588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:15.123038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:15.124008 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:15.124644 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:15.125470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:15.281859 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:15.290460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:15.292635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:15.295016 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e2f74f2e-9a46-4a9f-bedd-125796d01dbc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.186289 Sep 28 08:43:15.295813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 240/512] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:15 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:16.323252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:16.324635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:16.331845 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:16.332627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:16.333187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:16.333965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:16.334489 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:16.335194 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:16.498877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:16.507704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:16.509781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:16.511786 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8b613769-d4c1-4fee-9832-f7f0a4c1acfc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.193152 Sep 28 08:43:16.526943 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 273/513] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:16 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:17.538005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:17.538887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:17.546596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:17.547065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:17.547502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:17.548203 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:17.548797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:17.549380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:17.693507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:17.702353 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:17.703796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:17.704955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2d4ab755-2c0c-4954-82b3-ec8322f3a204 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1740 microversion: 2.20 time: 0.171109 Sep 28 08:43:17.705537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 241/514] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:17 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:18.034847 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:18.037159 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:18.044063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:18.044582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:18.045022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:18.045745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:18.046202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:18.046629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:18.070816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'flavor' on Instance uuid fde027c2-5ced-4b17-abcd-d13aae06a1aa {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:43:18.192471 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cbf7abeb-4c37-4465-835a-486fc062e43b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/action" status: 200 len: 32 microversion: 2.1 time: 0.161460 Sep 28 08:43:18.192998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 274/515] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:43:18 2022] POST /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:43:18.203143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:18.203751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:18.211154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:18.211887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:18.212345 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:18.213256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:18.213810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:18.214242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:18.354238 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:18.362336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-798bf843-ffd7-4c93-ab45-e3a1aeaba579 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.163075 Sep 28 08:43:18.362889 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 242/516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:18 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:18.731914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:18.732601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:18.739273 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:18.740018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:18.740451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:18.741175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:18.741786 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:18.742044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:18.978174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:18.987581 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:18.989231 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:18.990407 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ddf88314-41c5-412d-936a-80774445668c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1722 microversion: 2.20 time: 0.263332 Sep 28 08:43:18.991138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 275/517] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:18 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:19.386190 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:19.386812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:19.393009 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:19.393530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:19.393961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:19.394638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:19.395083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:19.395502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:19.781862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:19.790124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-77ccb561-2b1d-4ea6-a0eb-570366a151c0 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.408253 Sep 28 08:43:19.790679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 243/518] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:19 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:20.015265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:20.015879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:20.022265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:20.022744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:20.023181 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:20.023875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:20.024328 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:20.024755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:20.150493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:20.158725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:20.160189 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:20.161373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-25126c9d-5383-4457-83d8-2e7f3d42a6f3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1722 microversion: 2.20 time: 0.149970 Sep 28 08:43:20.161931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 276/519] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:20 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:20.708231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-608930d9-59f5-4ec6-b37f-ff45e51c35b9 req-ccbcff22-a4e9-43a5-a6f2-3f4f82f29f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4", "name": "network-vif-unplugged", "status": "completed", "tag": "34490fea-8100-40b7-919a-078c2cfc5f1d"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:20.714209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 08:43:20.714372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Wed Sep 28 08:43:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.52) !!! Sep 28 08:43:20.722251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-608930d9-59f5-4ec6-b37f-ff45e51c35b9 req-ccbcff22-a4e9-43a5-a6f2-3f4f82f29f8f service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:20.722733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-608930d9-59f5-4ec6-b37f-ff45e51c35b9 req-ccbcff22-a4e9-43a5-a6f2-3f4f82f29f8f service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:20.723179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-608930d9-59f5-4ec6-b37f-ff45e51c35b9 req-ccbcff22-a4e9-43a5-a6f2-3f4f82f29f8f service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:20.734272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-608930d9-59f5-4ec6-b37f-ff45e51c35b9 req-ccbcff22-a4e9-43a5-a6f2-3f4f82f29f8f service nova] Creating event network-vif-unplugged:34490fea-8100-40b7-919a-078c2cfc5f1d for instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 on hv-cinder-84456 Sep 28 08:43:20.739450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-608930d9-59f5-4ec6-b37f-ff45e51c35b9 req-ccbcff22-a4e9-43a5-a6f2-3f4f82f29f8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034828 Sep 28 08:43:20.740053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 244/520] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:43:20.814013 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:20.814626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:20.820762 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:20.821297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:20.821783 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:20.822967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:20.823424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:20.823858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:20.955000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:20.963754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-835b0036-0bfc-4b35-9804-d1db0d706e35 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.152995 Sep 28 08:43:20.964318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 277/521] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:20 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:21.188527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:21.189186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:21.195335 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:21.195820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:21.196260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:21.196951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:21.198089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:21.198523 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:21.327262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:21.335398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:21.336854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:21.338059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ffd7d316-55b1-4334-aad4-487e50f58a33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1722 microversion: 2.20 time: 0.153950 Sep 28 08:43:21.338622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 245/522] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:21 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:21.986993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:21.987592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:21.993945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:21.994471 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:21.994901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:21.995577 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:21.996097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:21.996514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:22.133025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:22.141237 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-73e5666f-8cc1-4fab-a3fb-c45f2d3476dc tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.158011 Sep 28 08:43:22.141801 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 278/523] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:21 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:22.363072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:22.363605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:22.370263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:22.371165 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:22.371944 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:22.373364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:22.373939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:22.374392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:22.503721 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:22.512272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:22.513770 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:22.514918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4bdcf738-c21c-4c2e-9f9c-738c491d2bdc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1665 microversion: 2.20 time: 0.155883 Sep 28 08:43:22.515632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 246/524] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:22 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:22.539834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f177a2e-8b3b-41ea-aeaf-4c07c9835e3c"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:22.542314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:22.548546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:22.549017 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:22.549482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:22.550172 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:22.550611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:22.551064 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:22.826653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-67fe5420-a8a0-40f6-8c7c-193dbea5b46a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290566 Sep 28 08:43:22.827290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 279/525] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Sep 28 08:43:22 2022] POST /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:43:22.955163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:22.955759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:22.961646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:22.962132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:22.962570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:22.963297 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:22.963752 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:22.964178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:23.049455 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127110) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 08:43:23.116762 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b5a35652-c676-4ddc-b775-5235c24814b6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/action" status: 202 len: 0 microversion: 2.20 time: 0.165349 Sep 28 08:43:23.117406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 247/526] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 08:43:22 2022] POST /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:43:23.126311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:23.126899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:23.134310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:23.134908 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:23.135405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:23.136100 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:23.136642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:23.137063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:23.164590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:23.165327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:23.172711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:23.173273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:23.173696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:23.174394 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:23.174855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:23.175278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:23.328405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:23.340855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:23.342381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:23.343703 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8e8b0605-f1c1-43c6-80da-9057eea3ce7a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1751 microversion: 2.20 time: 0.221511 Sep 28 08:43:23.357204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 280/527] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:23 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:23.357501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:23.360227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1e979f81-d1ca-466d-8ad1-cdea7b9534ef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.199438 Sep 28 08:43:23.361154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 248/528] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:23 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:24.370655 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:24.371257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:24.377827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:24.378303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:24.378818 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:24.379507 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:24.379951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:24.380365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:24.384193 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:24.385655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:24.392015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:24.392497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:24.392938 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:24.393704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:24.394164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:24.394592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:24.582616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:24.587537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:24.591266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:24.593919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:24.595383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:24.596583 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6b1f0bc6-e632-4e47-9f34-06974145de1e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1753 microversion: 2.20 time: 0.230264 Sep 28 08:43:24.597516 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 281/529] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:24 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:24.600236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-26102811-1af9-445c-92a7-519953443879 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.219925 Sep 28 08:43:24.600798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 249/530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:24 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:25.625878 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:25.626482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:25.626768 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:25.627599 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:25.633066 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:25.633606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:25.634043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:25.634253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:25.634772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:25.635379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:25.635753 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:25.635884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:25.636176 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:25.636502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:25.636954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:25.637402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:25.836083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:25.840381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:25.844270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-166da543-c963-43ba-bbd1-c1ff724a552a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.221630 Sep 28 08:43:25.844843 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 250/531] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:25 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:25.849454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:25.850925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:25.852070 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-98ab95b7-6593-43fa-9fce-57823cd108ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.231758 Sep 28 08:43:25.852609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 282/532] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:25 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:26.867500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:26.868137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:26.874494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:26.874955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:26.875385 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:26.877352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:26.877809 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:26.878231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:26.878556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:26.879171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:26.886882 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:26.887461 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:26.887972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:26.888830 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:26.889556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:26.893120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:27.125659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:27.130861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:27.136745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bb94dc59-5d19-4345-8862-19b493fb35ee tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.272845 Sep 28 08:43:27.137366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 251/533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:26 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:27.156017 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:27.157501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:27.158704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3bede5d2-83f2-43d2-95e5-83d2cab81229 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.284951 Sep 28 08:43:27.159261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 283/534] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:26 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:28.160339 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:28.160894 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:28.167911 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:28.168647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:28.169079 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:28.169875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:28.170330 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:28.170754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:28.183757 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:28.184360 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:28.190733 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:28.191218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:28.191641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:28.192336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:28.192777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:28.193225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:28.405653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:28.413049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:28.415505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:28.415729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:28.416963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:28.421628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-70630382-2242-4b23-8151-60b9ad0f84bd tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.238389 Sep 28 08:43:28.421628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 284/535] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:28 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:28.424281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-65240811-fc68-4732-b4a2-16f8ba027ffb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.267817 Sep 28 08:43:28.428328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 252/536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:28 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:29.448184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:29.448839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:29.449841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:29.450288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:29.459951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:29.460445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:29.461052 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:29.462201 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:29.462653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:29.463617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:29.464124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:29.464468 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:29.464616 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:29.465596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:29.466246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:29.467000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:29.670723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:29.682854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:29.685072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:29.687873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:29.689890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d3669007-8090-42df-99f9-56ff4bf1a2bf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.246867 Sep 28 08:43:29.701168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4decf63a-f705-4624-9439-7dc72c55232f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.247465 Sep 28 08:43:29.701168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 253/537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:29 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:29.701928 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 285/538] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:29 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:30.717381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:30.720115 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:30.724219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:30.724830 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:30.726851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:30.727482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:30.728261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:30.728607 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:30.729645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:30.730070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:30.733542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:30.734243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:30.734940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:30.735899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:30.736653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:30.737329 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:30.941663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:30.948428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:30.949876 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9b8936f2-4174-443b-b45e-66d26eb7bdcd tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.236515 Sep 28 08:43:30.950446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 254/539] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:30 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:30.957228 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:30.958675 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:30.959831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-64389ea8-3ccb-40ab-bc85-463d1b5dfd55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.240068 Sep 28 08:43:30.960381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 286/540] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:30 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:31.973572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:31.974190 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:31.981052 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:31.981596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:31.982037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:31.992729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:31.992729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:31.992729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:31.993112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:31.993112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:31.993112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:31.993729 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:31.993729 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:31.994378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:31.995652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:31.996351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:32.194129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:32.203718 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:32.208170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:32.211205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:32.212713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b4fcbc35-6a11-4864-8944-714d35a09e77 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.230587 Sep 28 08:43:32.219292 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f5fe157a-4ab4-4e97-ac22-684116616608 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.249469 Sep 28 08:43:32.220055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 255/541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:31 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:32.220198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 287/542] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:31 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:33.243719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:33.244431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:33.250104 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:33.250711 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:33.251126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:33.252092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:33.252092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:33.252706 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:33.253239 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:33.253719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:33.258054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:33.258544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:33.259247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:33.260175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:33.261383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:33.261958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:33.469861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:33.476126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:33.478627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:33.480592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:33.481884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7ba381a7-047e-47e5-b7ce-960712942737 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.235593 Sep 28 08:43:33.482572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 288/543] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:33 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:33.485244 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-cc1b6f36-09fa-4b97-badc-0469f0bd7b3a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.245299 Sep 28 08:43:33.485764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 256/544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:33 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:34.507833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:34.508519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:34.508909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:34.509022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:34.515720 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:34.516622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:34.517127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:34.517562 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:34.517684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:34.518045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:34.518879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:34.518994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:34.519363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:34.519800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:34.519939 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:34.520378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:34.771652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:34.781585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:34.786255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:34.787828 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:34.789179 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d46130c0-b288-47cc-acdc-7ca1490ead6e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.285244 Sep 28 08:43:34.789755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 289/545] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:34 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:34.790130 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-03556e8b-a580-4441-8edf-2d6c5a47c83d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.285394 Sep 28 08:43:34.790690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 257/546] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:34 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:43:35.814243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:35.815046 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:35.816125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:35.817314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:35.825407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:35.826258 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:35.826921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:35.827861 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:35.828548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:35.829236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:35.830863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:35.832077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:35.832525 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:35.836406 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:35.836986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:35.837450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:36.032386 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:36.041423 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:36.043255 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:36.044837 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-cc40a9a4-8245-4335-8698-6ddbea1fa921 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.233503 Sep 28 08:43:36.045452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 258/547] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:35 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:36.069449 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:36.078540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-23983553-5ced-44bf-bcfd-8b1fb10c8976 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.268648 Sep 28 08:43:36.082520 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 290/548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:35 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:37.073328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:37.073907 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:37.080285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:37.080765 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:37.081228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:37.081922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:37.082398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:37.082821 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:37.113372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:37.115060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:37.122506 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:37.123450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:37.124233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:37.125352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:37.126047 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:37.126755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:37.350243 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:37.353437 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:37.358560 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ddb3b5cd-69dd-4079-92a2-7ecd7b6089eb tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.254466 Sep 28 08:43:37.359230 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 291/549] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:37 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:37.362045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:37.363513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:37.364679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-737d6880-6f74-4313-a000-0309ae8b8e01 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.295555 Sep 28 08:43:37.365253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 259/550] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:37 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:38.383699 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:38.384315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:38.390982 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:38.391550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:38.391703 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:38.391953 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:38.392115 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:38.392827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:38.393312 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:38.393748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:38.398816 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:38.399341 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:38.399724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:38.400414 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:38.400860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:38.401301 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:38.584539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:38.587181 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:38.593292 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d5151873-9796-432c-803a-869a0fe80dd7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.214035 Sep 28 08:43:38.593874 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 292/551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:38 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:38.596603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:38.598257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:38.599540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b50569f8-024a-452b-aae9-3245703e5776 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.213121 Sep 28 08:43:38.600175 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 260/552] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:38 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:39.618334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:39.618948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:39.625605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:39.626111 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:39.626219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:39.626579 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:39.627019 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:39.627725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:39.628176 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:39.628604 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:39.633618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:39.633618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:39.633618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:39.634018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:39.634484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:39.634901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:39.826000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:39.830769 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:39.836687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-80b189eb-85c3-47ce-b815-85ea176f451a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.222136 Sep 28 08:43:39.837342 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 293/553] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:39 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:39.840678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:39.842250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:39.843566 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8890f053-ca2e-485d-b562-380377ce2689 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.221970 Sep 28 08:43:39.844095 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 261/554] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:39 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:40.863348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:40.864370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:40.878549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:40.879406 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:40.880263 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:40.881275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:40.882055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:40.882779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:40.884063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:40.885044 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:40.896850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:40.897693 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:40.898426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:40.899627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:40.900408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:40.901150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:41.102988 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:41.112191 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-665c0225-5174-4a4e-85e1-9226572390e8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.255723 Sep 28 08:43:41.113495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 294/555] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:40 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:43:41.118104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:41.131946 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:41.133531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:41.134735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-cd5d76b2-fe4b-4f5d-a041-a5b630a43383 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.260095 Sep 28 08:43:41.135277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 262/556] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:40 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:42.148859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:42.149492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:42.156898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:42.157442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:42.157887 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:42.158605 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:42.159071 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:42.159565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:42.160926 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:42.161937 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:42.170648 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:42.171235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:42.171723 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:42.172527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:42.173043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:42.173553 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:42.392303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:42.398713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:42.407698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-06f506fd-4699-4918-a9e1-31ffd7c8ee54 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.262426 Sep 28 08:43:42.408509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:42.408657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 295/557] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:42 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:42.410019 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:42.411268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-66159654-8589-4424-b058-88a119ca3ae2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.254991 Sep 28 08:43:42.411848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 263/558] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:42 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:43.445241 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:43.445849 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:43.452997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:43.453521 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:43.453956 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:43.454671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:43.455136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:43.455555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:43.457842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:43.458757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:43.467678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:43.468174 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:43.468609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:43.469590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:43.470044 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:43.470464 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:43.672925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:43.675035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:43.684334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:43.685802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:43.686622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3e18d6d1-7a83-463b-9403-56a552183d20 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.245020 Sep 28 08:43:43.686960 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7bf7d3e5-df38-44ca-9f38-ffd25b7708f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.234997 Sep 28 08:43:43.687198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 296/559] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:43 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:43.687500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 264/560] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:43 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:44.712419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:44.713018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:44.713440 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:44.713548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:44.715695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=50 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:44.720291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:44.720782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:44.721013 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:44.721257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:44.721550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:44.721967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:44.722085 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:44.722423 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:44.722662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:44.722847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:44.723110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:44.723531 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:44.930945 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:44.943317 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:44.945824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:44.948407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:44.950272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8fd7c89e-bd9a-4ee6-ad0e-c0772a83cf1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.241185 Sep 28 08:43:44.950858 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 265/561] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:44 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:44.952195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-652508bf-45db-480f-b69e-a29b598c5b65 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.245112 Sep 28 08:43:44.952774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 297/562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:44 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:45.975811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:45.976509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:45.976865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:45.976954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:45.978778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:45.983069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:45.983553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:45.983984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:45.984209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:45.984676 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:45.984809 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:45.985153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:45.985303 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:45.985574 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:45.985857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:45.986308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:45.986741 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:46.010196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:46.211031 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:46.218223 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:46.223500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c38b2db4-882c-4993-89dc-fba5efb522c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.251523 Sep 28 08:43:46.224286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 298/563] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:45 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:43:46.227097 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:46.228488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:46.230217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bc753cea-454b-487e-b595-e578e6459c05 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.257843 Sep 28 08:43:46.230773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 266/564] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:45 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:47.248382 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:47.249301 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:47.256290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:47.256781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:47.257246 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:47.257948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:47.258398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:47.258816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:47.266373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:47.266981 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:47.275712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:47.276518 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:47.277626 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:47.278530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:47.279087 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:47.279607 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:47.474030 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:47.482925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3da14813-6ad4-4d22-8db0-ccda785621cf tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1733 microversion: 2.1 time: 0.239247 Sep 28 08:43:47.483501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 299/565] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:47 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1733 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:43:47.487246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:47.503748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:47.506588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:47.508773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a9e8ecdd-1211-45ea-8bb4-038cd085437a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.246045 Sep 28 08:43:47.509831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 267/566] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:47 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:48.506617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:48.507190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:48.514117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.514612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.515051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.515769 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.516242 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.516672 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.555546 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:48.556251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:48.564278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.564777 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.565250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.565985 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.566445 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.566871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.715635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:48.723815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-38245e87-a1e2-456c-89c4-e67c2ff8f8d4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1713 microversion: 2.1 time: 0.221287 Sep 28 08:43:48.724386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 300/567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:48 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1713 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:48.742695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:48.752456 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:48.753947 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:48.755108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5fc657fa-8dc5-4774-84e5-1e7265cf791d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.203608 Sep 28 08:43:48.755654 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 268/568] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:48 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:43:48.788305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:48.788801 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:48.795730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.796218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.796660 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.797377 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.797835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.798259 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.930083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] HTTP exception thrown: Cannot 'detach_volume' instance fde027c2-5ced-4b17-abcd-d13aae06a1aa while it is in vm_state rescued Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Request method failure captured: Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments/cd8eeb76-0b57-4d24-ae2e-0e50ab1fa350 HTTP/1.1 Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf1E8anRpf9Y3Phr433YXemtTmRCIPS0gN4YK9hNtuYt44jxbho8BovV3qNnp3m2RFR2ibzPeasINTLiedCt52ce5SAyNjwFYwpWLPhGBJqSFGpHL1zJfQbGgFFriB_YBnLHbC80pjy61XCtUIULs1ZgDjNtyRekNy3hLZpD_ANccU Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:43:48.931827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42699952850d49fdafb670aeb5f613ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7d712e201f2c47a8a48b6e24559e0d60 Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:43:48.933930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Cannot 'detach_volume' instance fde027c2-5ced-4b17-abcd-d13aae06a1aa while it is in vm_state rescued Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'server_id': 'fde027c2-5ced-4b17-abcd-d13aae06a1aa', 'id': 'cd8eeb76-0b57-4d24-ae2e-0e50ab1fa350'} Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fde027c2-5ced-4b17-abcd-d13aae06a1aa in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:43:48.935057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fde027c2-5ced-4b17-abcd-d13aae06a1aa while it is in vm_state rescued Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fde027c2-5ced-4b17-abcd-d13aae06a1aa while it is in vm_state rescued Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:43:48.936739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Returning 409 to user: Cannot 'detach_volume' instance fde027c2-5ced-4b17-abcd-d13aae06a1aa while it is in vm_state rescued {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:43:48.938905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0378c3b9-dedd-4466-91a4-3a8393a0cc66 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments/cd8eeb76-0b57-4d24-ae2e-0e50ab1fa350" status: 409 len: 152 microversion: 2.1 time: 0.149123 Sep 28 08:43:48.938905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 301/569] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:43:48 2022] DELETE /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments/cd8eeb76-0b57-4d24-ae2e-0e50ab1fa350 => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 28 08:43:48.947219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:48.948256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:48.958601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.959571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.960202 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.961590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:48.962373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:48.963185 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:48.989925 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:43:49.059674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-11295530-0b35-4090-a3cd-1b45764324c1 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "POST /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/action" status: 202 len: 0 microversion: 2.1 time: 0.119062 Sep 28 08:43:49.060850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 269/570] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:43:48 2022] POST /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:43:49.068898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:49.069543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:49.076196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:49.076683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:49.077132 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:49.077840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:49.078292 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:49.078919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:49.220301 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:49.232822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1a5bf7dd-78f3-4cde-929f-97a33f8377ea tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1721 microversion: 2.1 time: 0.167781 Sep 28 08:43:49.233432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 302/571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:49 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:49.781917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:49.782625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:49.788844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:49.789363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:49.789810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:49.790507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:49.790957 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:49.791380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:50.030900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:50.040394 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:50.041822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:50.043575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6a86b60c-1efc-4220-be71-d5e53358c29b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.266518 Sep 28 08:43:50.044403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 270/572] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:49 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:50.256386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:50.257040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:50.264139 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:50.264781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:50.265295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:50.266007 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:50.266492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:50.266916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:50.639366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:50.647903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4403e432-7484-47af-9929-32f0e95c35c5 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1721 microversion: 2.1 time: 0.395425 Sep 28 08:43:50.648483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 303/573] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:50 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:51.072659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:51.074315 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:51.082292 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:51.082872 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:51.083373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:51.084417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:51.085010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:51.085675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:51.184022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-df92c19e-cd2c-4ebe-8def-b5168bdcfadd req-e39b0190-a232-40e3-8e74-d95e0177751b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4", "name": "network-vif-plugged", "status": "completed", "tag": "34490fea-8100-40b7-919a-078c2cfc5f1d"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:51.196648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-df92c19e-cd2c-4ebe-8def-b5168bdcfadd req-e39b0190-a232-40e3-8e74-d95e0177751b service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:51.197289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-df92c19e-cd2c-4ebe-8def-b5168bdcfadd req-e39b0190-a232-40e3-8e74-d95e0177751b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:51.197823 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-df92c19e-cd2c-4ebe-8def-b5168bdcfadd req-e39b0190-a232-40e3-8e74-d95e0177751b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:51.210788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-df92c19e-cd2c-4ebe-8def-b5168bdcfadd req-e39b0190-a232-40e3-8e74-d95e0177751b service nova] Creating event network-vif-plugged:34490fea-8100-40b7-919a-078c2cfc5f1d for instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 on hv-cinder-84456 Sep 28 08:43:51.217410 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-df92c19e-cd2c-4ebe-8def-b5168bdcfadd req-e39b0190-a232-40e3-8e74-d95e0177751b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Sep 28 08:43:51.218707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 304/574] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:43:51.255673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:51.265403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:51.266880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:51.268156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-258782a0-c7fa-4932-8cb9-fc879a8424fb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.199766 Sep 28 08:43:51.268691 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 271/575] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:51 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:51.674131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:51.674855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:51.681195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:51.681686 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:51.682123 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:51.683426 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:51.683883 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:51.684309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:51.818554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:51.829150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d53f0041-570e-4d44-af24-096148a78fe9 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1721 microversion: 2.1 time: 0.160406 Sep 28 08:43:51.829720 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 305/576] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:51 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:52.294930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:52.295542 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:52.302314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:52.302803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:52.303241 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:52.303942 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:52.304397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:52.304824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:52.441291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:52.450206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:52.451656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:52.452825 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-38bc7ca7-cc1e-422c-9a95-018e040d5ed3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.162633 Sep 28 08:43:52.453415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 272/577] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:52 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:52.853405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:52.854050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:52.863469 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:52.863961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:52.864406 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:52.865133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:52.865592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:52.866012 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:53.007178 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:53.022708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f9add03f-1c1b-40fe-a66f-c9e2c7069013 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1721 microversion: 2.1 time: 0.172817 Sep 28 08:43:53.023770 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 306/578] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:52 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:53.477973 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:53.478587 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:53.485790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:53.486284 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:53.486731 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:53.487446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:53.487904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:53.488334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:53.628594 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:53.638600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:53.640040 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:53.641236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1fc0f30a-a919-49d8-9cba-4c83fd637420 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.167256 Sep 28 08:43:53.641787 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 273/579] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:53 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:54.047203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:54.047846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:54.054365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:54.054848 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:54.055286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:54.055983 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:54.056437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:54.056858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:54.192262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:54.201533 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b02f5ad7-2712-451b-88c0-8ca9ba4af71a tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1721 microversion: 2.1 time: 0.158423 Sep 28 08:43:54.202098 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 307/580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:54 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:54.670371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:54.670963 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:54.677422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:54.677924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:54.678369 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:54.679063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:54.679521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:54.680563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:54.847584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:54.857162 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:54.858621 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:54.859808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-dae0414e-1335-4217-a829-22407c213306 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.194094 Sep 28 08:43:54.860375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 274/581] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:54 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:55.224141 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:55.224754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:55.232256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:55.232779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:55.233680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:55.234379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:55.234843 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:55.235277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:55.370120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:55.378924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-df26f23a-28da-4afd-bb81-3d2fdf9152a8 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1727 microversion: 2.1 time: 0.158612 Sep 28 08:43:55.379500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 308/582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:43:55 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:43:55.401486 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:55.401977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:55.408009 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:55.408494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:55.408932 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:55.409668 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:55.410123 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:55.410550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:55.490881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9c0c75bb-794b-498c-a39b-64730bce6981 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093389 Sep 28 08:43:55.491488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 275/583] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:43:55 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:43:55.887026 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:55.887543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:55.893786 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:55.894276 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:55.894708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:55.895420 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:55.895863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:55.896285 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:56.113822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:56.123864 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:56.125423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:56.126627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ec0a0121-07da-4c5c-a280-e3c6827bc44a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.244715 Sep 28 08:43:56.127189 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 309/584] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:55 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:56.609717 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-b9ff3685-b3e7-4c67-8ceb-a93ee7b2bba6 req-264069f0-ef28-40be-9e0a-08aca28b0e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde027c2-5ced-4b17-abcd-d13aae06a1aa", "tag": "cd365a60-ac04-41d0-9a07-5370af59c807"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:56.620696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b9ff3685-b3e7-4c67-8ceb-a93ee7b2bba6 req-264069f0-ef28-40be-9e0a-08aca28b0e31 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:56.621310 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b9ff3685-b3e7-4c67-8ceb-a93ee7b2bba6 req-264069f0-ef28-40be-9e0a-08aca28b0e31 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:56.621838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b9ff3685-b3e7-4c67-8ceb-a93ee7b2bba6 req-264069f0-ef28-40be-9e0a-08aca28b0e31 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:56.633862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-b9ff3685-b3e7-4c67-8ceb-a93ee7b2bba6 req-264069f0-ef28-40be-9e0a-08aca28b0e31 service nova] Creating event network-changed:cd365a60-ac04-41d0-9a07-5370af59c807 for instance fde027c2-5ced-4b17-abcd-d13aae06a1aa on hv-cinder-84456 Sep 28 08:43:56.645483 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-b9ff3685-b3e7-4c67-8ceb-a93ee7b2bba6 req-264069f0-ef28-40be-9e0a-08aca28b0e31 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137654 Sep 28 08:43:56.646482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 276/585] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:43:57.151850 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:57.152464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:57.159565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:57.160316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:57.160916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:57.161785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:57.162174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:57.162559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:57.408911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:57.423491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:57.425344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:57.426885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ff7adafe-29cb-44fe-a993-46cdf7bf432a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1809 microversion: 2.20 time: 0.278995 Sep 28 08:43:57.442554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 310/586] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:57 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1809 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:58.456711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:43:58.457427 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:43:58.463651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:58.464129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:58.464568 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:58.465291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:58.465744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:58.466168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:58.594690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:58.603458 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:58.605665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:43:58.606836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-861d8d6c-c5a5-488a-b76c-7d586bb3cf25 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1796 microversion: 2.20 time: 0.154930 Sep 28 08:43:58.607405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 277/587] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:43:58 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1796 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:43:58.661968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-07d69472-e924-4c2c-b758-b62d2f49f264 req-ae67e8df-26aa-4f53-907b-40f966470fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde027c2-5ced-4b17-abcd-d13aae06a1aa", "tag": "cd365a60-ac04-41d0-9a07-5370af59c807"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:43:58.672825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-07d69472-e924-4c2c-b758-b62d2f49f264 req-ae67e8df-26aa-4f53-907b-40f966470fc2 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:43:58.673348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-07d69472-e924-4c2c-b758-b62d2f49f264 req-ae67e8df-26aa-4f53-907b-40f966470fc2 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:43:58.673772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-07d69472-e924-4c2c-b758-b62d2f49f264 req-ae67e8df-26aa-4f53-907b-40f966470fc2 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:43:58.685693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-07d69472-e924-4c2c-b758-b62d2f49f264 req-ae67e8df-26aa-4f53-907b-40f966470fc2 service nova] Creating event network-changed:cd365a60-ac04-41d0-9a07-5370af59c807 for instance fde027c2-5ced-4b17-abcd-d13aae06a1aa on hv-cinder-84456 Sep 28 08:43:58.691424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-07d69472-e924-4c2c-b758-b62d2f49f264 req-ae67e8df-26aa-4f53-907b-40f966470fc2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032939 Sep 28 08:43:58.692129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 311/588] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:15.464709 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=23 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:15.466064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:15.566951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:15.567473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:15.573505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:15.573984 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:15.574438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:15.575129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:15.575579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:15.575999 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:15.704287 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lazy-loading 'services' on Instance uuid bdf04325-2791-450a-8f0c-7ab39f891ec4 {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:44:15.829273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0af684b8-55d9-4384-9349-a385a3036473 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-volume_attachments/b021f4ff-da71-44dd-8490-832857972e07" status: 202 len: 0 microversion: 2.1 time: 0.369511 Sep 28 08:44:15.830159 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 278/589] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:44:15 2022] DELETE /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-volume_attachments/b021f4ff-da71-44dd-8490-832857972e07 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:44:18.008709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=29 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:18.009475 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=72 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:18.014296 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-67373e2e-335b-4a09-a524-88555c793fc8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:18.021187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67373e2e-335b-4a09-a524-88555c793fc8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:18.021678 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67373e2e-335b-4a09-a524-88555c793fc8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:18.022119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-67373e2e-335b-4a09-a524-88555c793fc8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:18.084034 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-67373e2e-335b-4a09-a524-88555c793fc8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Going to try to stop instance {{(pid=127111) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 28 08:44:18.085514 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:18.086140 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:18.092886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:18.093396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:18.093834 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:18.094532 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:18.094989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:18.095441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:18.120056 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lazy-loading 'flavor' on Instance uuid 901f2acc-6433-42cb-a931-82ccde824010 {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:44:18.129174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-67373e2e-335b-4a09-a524-88555c793fc8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.121866 Sep 28 08:44:18.129788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 312/590] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:44:18 2022] POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:44:18.138202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:18.138896 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:18.145344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:18.145527 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:18.146005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:18.146664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:18.147092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:18.147513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:18.246452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ad5fbaf5-4f8a-44a3-8a64-6739221a5550 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "POST /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010/action" status: 202 len: 0 microversion: 2.1 time: 0.165916 Sep 28 08:44:18.250248 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 279/591] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:44:18 2022] POST /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:44:18.256715 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:18.257577 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:18.265935 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:18.267850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:18.267850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:18.267850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:18.268140 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:18.268496 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:18.302595 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:18.310581 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b98a53cd-ba20-4d0a-ac24-f73387239da3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.176410 Sep 28 08:44:18.311136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 313/592] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:18 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:18.405891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:18.413736 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a266b9ee-5ddf-452c-8ec1-305608ddcd05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.162307 Sep 28 08:44:18.414302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 280/593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:18 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:19.333842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:19.334466 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:19.341245 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.341732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.342171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.342862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.343316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.343743 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.438415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:19.439032 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:19.445443 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.445935 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.446374 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.447073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.448157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.448595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.476856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:19.485127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1ebb55a2-05f9-44a1-ad9d-60d78fd104d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.155084 Sep 28 08:44:19.485680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 314/594] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:19 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:19.554318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:19.554841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:19.560915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.561473 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.562011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.562714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.563170 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.563599 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.581684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:19.587571 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-60b4974e-d1e8-4161-8137-bfef5a042ae2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee/ips" status: 200 len: 148 microversion: 2.1 time: 0.100773 Sep 28 08:44:19.588302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 315/595] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:44:19 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee/ips => generated 148 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:19.592653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f7798056-b6ad-4dfe-a6d0-052d74cb7b09 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.159332 Sep 28 08:44:19.593373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 281/596] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:19 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:19.600308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aa6261b-8d3f-4a84-b301-547902f792c6"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:19.602941 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:19.609941 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.610428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.610860 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.611553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.612004 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.612423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.694946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Invalid volume: volume 9aa6261b-8d3f-4a84-b301-547902f792c6 is already attached to instances: 1d333fe6-3d16-47c6-9104-714c67456652 Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: POST /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee/os-volume_attachments HTTP/1.1 Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 74 Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:44:19.696690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {"volumeAttachment": {"volumeId": "9aa6261b-8d3f-4a84-b301-547902f792c6"}} Sep 28 08:44:19.698439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Invalid volume: volume 9aa6261b-8d3f-4a84-b301-547902f792c6 is already attached to instances: 1d333fe6-3d16-47c6-9104-714c67456652 Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'server_id': '489154e1-8189-48c2-9b84-b7f0c34221ee', 'body': {'volumeAttachment': {'volumeId': '9aa6261b-8d3f-4a84-b301-547902f792c6'}}} Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9aa6261b-8d3f-4a84-b301-547902f792c6 is already attached to instances: 1d333fe6-3d16-47c6-9104-714c67456652 Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:44:19.700262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9aa6261b-8d3f-4a84-b301-547902f792c6 is already attached to instances: 1d333fe6-3d16-47c6-9104-714c67456652 Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:19.701454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9aa6261b-8d3f-4a84-b301-547902f792c6 is already attached to instances: 1d333fe6-3d16-47c6-9104-714c67456652 Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 400 to user: Invalid volume: volume 9aa6261b-8d3f-4a84-b301-547902f792c6 is already attached to instances: 1d333fe6-3d16-47c6-9104-714c67456652 {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-153bedc0-76f1-43f1-bca0-c02cc2ff6bfd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101852 Sep 28 08:44:19.702914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 316/597] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:44:19 2022] POST /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:44:19.707822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:19.708348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:19.714214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.714754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.715186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.715874 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.716325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.716748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.742356 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:44:19.826961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d1bbabdc-92f0-49e7-b668-4cf7f175ebf8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 204 len: 0 microversion: 2.1 time: 0.122655 Sep 28 08:44:19.827735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 282/598] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:44:19 2022] DELETE /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:44:19.835784 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:19.836415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:19.843443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.843859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.844291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.844973 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:19.845476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:19.845897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:19.973817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:19.981866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c7f8835d-36db-4a78-a7b2-aa1530cb32d4 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1680 microversion: 2.1 time: 0.149861 Sep 28 08:44:19.982418 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 317/599] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:19 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:20.510534 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:20.511226 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:20.518097 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:20.518583 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:20.519011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:20.519717 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:20.520163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:20.520583 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:20.620265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:20.620915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:20.627261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:20.627769 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:20.628203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:20.628892 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:20.629376 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:20.629798 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:20.654888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:20.662601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ee3b625c-ec52-4408-9be0-b4dcc0e456d3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.156262 Sep 28 08:44:20.663163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 283/600] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:20 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:20.771160 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:20.778859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e1348a0e-f526-48be-bb35-882e68adba9d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.162381 Sep 28 08:44:20.779414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 318/601] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:20 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:21.006803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:21.007405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:21.013332 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:21.013810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:21.014246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:21.014933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:21.015382 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:21.015801 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:21.144899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:21.152994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7d854144-70d9-4a54-b16e-4784502151db tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1680 microversion: 2.1 time: 0.150102 Sep 28 08:44:21.153593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 284/602] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:21 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:21.686724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:21.687332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:21.693745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:21.694224 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:21.694659 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:21.695345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:21.695797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:21.696226 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:21.802611 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:21.803234 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:21.810136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:21.810625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:21.811065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:21.811764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:21.812218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:21.812975 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:21.827493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:21.835255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b4851dcb-c697-409c-8a6d-bd7564b00f7a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.152405 Sep 28 08:44:21.835816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 319/603] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:21 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:21.989803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:21.997977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-cf499120-f751-4d65-9b6f-9aca9765dd65 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.199330 Sep 28 08:44:21.998540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 285/604] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:21 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:22.177695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:22.178343 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:22.185309 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:22.185799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:22.186261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:22.186967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:22.187411 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:22.187829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:22.570623 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:22.579496 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-16efd6a2-485d-4cfd-bdc5-59218e4cca35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1680 microversion: 2.1 time: 0.405950 Sep 28 08:44:22.580067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 320/605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:22 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1680 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:22.859847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:22.861037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:22.867551 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:22.867928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:22.868401 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:22.869353 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:22.869886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:22.870331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:23.022177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:23.022952 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:23.030596 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:23.031397 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:23.031927 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:23.032850 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:23.033412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:23.033901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:23.065844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:23.075543 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d1f1b492-34b9-45be-bfb4-daa09ab318ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.220508 Sep 28 08:44:23.076388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 286/606] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:22 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:23.252935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:23.261346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0e95b324-d30a-415d-9e57-8d0ea07c4872 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.243109 Sep 28 08:44:23.262597 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 321/607] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:23 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:23.313974 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-edf16a62-f423-4e51-ab90-1fb298de3015 req-364e5c99-f26f-42c1-8ae5-ee117a1fd694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489154e1-8189-48c2-9b84-b7f0c34221ee", "name": "network-vif-deleted", "tag": "93ce9123-1418-4ef6-bd1c-914373525bb5"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:23.327726 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-edf16a62-f423-4e51-ab90-1fb298de3015 req-364e5c99-f26f-42c1-8ae5-ee117a1fd694 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:23.328446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-edf16a62-f423-4e51-ab90-1fb298de3015 req-364e5c99-f26f-42c1-8ae5-ee117a1fd694 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:23.329123 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-edf16a62-f423-4e51-ab90-1fb298de3015 req-364e5c99-f26f-42c1-8ae5-ee117a1fd694 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:23.342013 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-edf16a62-f423-4e51-ab90-1fb298de3015 req-364e5c99-f26f-42c1-8ae5-ee117a1fd694 service nova] Creating event network-vif-deleted:93ce9123-1418-4ef6-bd1c-914373525bb5 for instance 489154e1-8189-48c2-9b84-b7f0c34221ee on hv-cinder-84456 Sep 28 08:44:23.346982 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-edf16a62-f423-4e51-ab90-1fb298de3015 req-364e5c99-f26f-42c1-8ae5-ee117a1fd694 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040901 Sep 28 08:44:23.348171 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 287/608] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:23.604515 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:23.605730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:23.613548 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:23.614451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:23.615089 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:23.616043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:23.616743 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:23.617414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:23.658381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:23.658897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:23.659330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:23.659777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lazy-loading 'fault' on Instance uuid 489154e1-8189-48c2-9b84-b7f0c34221ee {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:44:23.706373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:23.716516 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7c9f97ad-a0e3-4b5a-bb24-95cf4372cfcc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 200 len: 1332 microversion: 2.1 time: 0.116359 Sep 28 08:44:23.717549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 322/609] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:23 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:24.100719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:24.101477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:24.108223 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:24.108695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:24.109154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:24.110036 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:24.110485 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:24.110903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:24.286170 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:24.286926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:24.293865 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:24.302373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:24.303375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:24.304233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:24.304607 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b5919692-670c-4330-a2a9-ad0596bb8627 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.208513 Sep 28 08:44:24.305454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 288/610] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:24 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:24.307286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:24.307937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:24.308566 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:24.471403 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:24.482139 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-faaf62b5-f2b9-4825-bb22-75bbf04c9b40 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.201287 Sep 28 08:44:24.485514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 323/611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:24 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:24.742073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:24.742683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:24.749323 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:24.749842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:24.750239 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:24.750924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:24.751376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:24.751823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:24.765711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee HTTP/1.1 Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:44:24.767371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:44:24.768961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '489154e1-8189-48c2-9b84-b7f0c34221ee'} Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:44:24.773530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:44:24.775011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:24.776286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:44:24.776286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c8d6f121-f1f1-4e08-9e47-b87ca89dbe46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 404 len: 111 microversion: 2.1 time: 0.030602 Sep 28 08:44:24.776286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 289/612] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:24 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:44:24.777915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-186a173c-3980-4641-8e64-859d23e9a5dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '.version_select at 0x7f984fc715e0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:24.798559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-186a173c-3980-4641-8e64-859d23e9a5dc tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248158950" status: 202 len: 0 microversion: 2.1 time: 0.024418 Sep 28 08:44:24.799133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 324/613] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 08:44:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1248158950 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:44:25.332615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:25.333309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:25.339477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.340453 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.340886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.341677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.342128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.342619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.477405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:25.485474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9f3a98f2-0ac0-4f54-b6cc-b682abedc2c8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.156523 Sep 28 08:44:25.486039 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 290/614] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:25 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:25.489559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:25.490053 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:25.497287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.497791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.498206 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.498944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.499365 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.499790 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.505537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:25.506147 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:25.512629 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.513201 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.513646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.514345 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.515119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.515239 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.534397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:25.586704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lazy-loading 'services' on Instance uuid 1d333fe6-3d16-47c6-9104-714c67456652 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:44:25.652641 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:25.661168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-78d4e12d-cf19-4658-bc6f-e8c826edc11f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.159287 Sep 28 08:44:25.661738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 291/615] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:25 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:25.703085 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6613e195-a2ba-4d24-aae4-49705d92184a tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments/9aa6261b-8d3f-4a84-b301-547902f792c6" status: 202 len: 0 microversion: 2.1 time: 0.218022 Sep 28 08:44:25.703719 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 325/616] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:44:25 2022] DELETE /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments/9aa6261b-8d3f-4a84-b301-547902f792c6 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:44:25.712636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:25.715476 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:25.721973 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.722567 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.722949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.723718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:25.724221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:25.724639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:25.754179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2104d9cc-901b-4a3a-a6f5-9777766353af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Sep 28 08:44:25.754747 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 292/617] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:44:25 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:26.509837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:26.510538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:26.517435 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.517935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.518368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.519075 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.519526 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.519949 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.662640 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:26.671542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7fb4b9b1-ed1e-43fa-bc03-38d301757373 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.166378 Sep 28 08:44:26.672121 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 326/618] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:26 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:26.687049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:26.688148 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:26.694807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.695293 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.695760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.696472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.696922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.697601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.767008 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:26.769456 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:26.775929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.776417 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.776892 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.777618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.778066 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.778485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.811266 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:26.816428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-46074d3e-7ff8-4c21-b359-358f7e28691e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053355 Sep 28 08:44:26.817002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 327/619] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:44:26 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 08:44:26.851103 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:26.859566 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0bb0bf3c-1abf-4c2c-a254-51d84e745034 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.177790 Sep 28 08:44:26.860144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 293/620] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:26 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:26.882757 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:26.883247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:26.890985 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.891477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.891914 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.892609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:26.893062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:26.893512 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:26.919089 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:44:26.998840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b5c3bd75-a2d3-4cec-85c9-25131538ca0b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 204 len: 0 microversion: 2.1 time: 0.119524 Sep 28 08:44:26.999350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 328/621] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:44:26 2022] DELETE /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:44:27.008072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:27.008675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:27.014890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:27.015364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:27.015799 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:27.016485 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:27.016922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:27.017564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:27.166171 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:27.174639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-08aaadce-5b46-485b-b656-52ecd99b86bf tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1680 microversion: 2.1 time: 0.170590 Sep 28 08:44:27.175206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 294/622] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:27 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:27.699837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:27.700571 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:27.706923 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:27.707404 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:27.707831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:27.708530 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:27.708987 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:27.709433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:27.838532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:27.846924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6a563f6e-9352-437b-88da-4c1a4e7150d5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.151504 Sep 28 08:44:27.847491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 329/623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:27 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:27.883085 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:27.883704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:27.890711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:27.891193 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:27.891630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:27.892317 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:27.892772 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:27.893231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:28.027625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:28.035236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8c55dfcb-b13f-47bf-bf62-2e01175b6627 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.155967 Sep 28 08:44:28.035729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 295/624] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:27 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:28.198606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:28.199223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:28.205500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:28.205984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:28.206424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:28.207117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:28.207574 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:28.208008 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:28.338937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:28.346852 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8f205bf2-89fa-4425-9837-efd603fb7b49 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1680 microversion: 2.1 time: 0.152213 Sep 28 08:44:28.347420 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 330/625] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:28 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:28.870558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:28.871167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:28.877107 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:28.877601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:28.878035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:28.878722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:28.879173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:28.879593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:29.004562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:29.012657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-84f1bb91-9b02-4657-b896-942726030e1d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.146088 Sep 28 08:44:29.013237 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 296/626] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:28 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:29.058234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:29.058846 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:29.065311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:29.065796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:29.066234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:29.066931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:29.067382 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:29.067809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:29.198439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:29.206875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5f3b03c9-b33b-402c-88c4-311c5750d077 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.152453 Sep 28 08:44:29.207832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 331/627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:29 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:29.372561 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:29.373500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:29.380747 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:29.381404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:29.381939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:29.382906 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:29.383581 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:29.384103 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:29.615610 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:29.624252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f9dfb5ff-0d86-4c9d-a2a7-db0a54fd72eb tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1680 microversion: 2.1 time: 0.256099 Sep 28 08:44:29.624831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 297/628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:29 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:30.036347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:30.036982 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:30.043192 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:30.043680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:30.044179 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:30.045157 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:30.045618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:30.046046 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:30.141162 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-90bb7484-cecb-4fb9-a42f-8e4396ebcc33 req-33584b5e-b484-4e76-9c44-b6a10889fdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d333fe6-3d16-47c6-9104-714c67456652", "name": "network-vif-deleted", "tag": "3e899002-2d72-495c-ac21-1db3e1f0ae42"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:30.152590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-90bb7484-cecb-4fb9-a42f-8e4396ebcc33 req-33584b5e-b484-4e76-9c44-b6a10889fdb8 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:30.153075 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-90bb7484-cecb-4fb9-a42f-8e4396ebcc33 req-33584b5e-b484-4e76-9c44-b6a10889fdb8 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:30.153528 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-90bb7484-cecb-4fb9-a42f-8e4396ebcc33 req-33584b5e-b484-4e76-9c44-b6a10889fdb8 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:30.165595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-90bb7484-cecb-4fb9-a42f-8e4396ebcc33 req-33584b5e-b484-4e76-9c44-b6a10889fdb8 service nova] Creating event network-vif-deleted:3e899002-2d72-495c-ac21-1db3e1f0ae42 for instance 1d333fe6-3d16-47c6-9104-714c67456652 on hv-cinder-84456 Sep 28 08:44:30.172011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-90bb7484-cecb-4fb9-a42f-8e4396ebcc33 req-33584b5e-b484-4e76-9c44-b6a10889fdb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Sep 28 08:44:30.173431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 298/629] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:30.213018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:30.221504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-90cfb42e-94ce-4dd8-bf53-205681e72908 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.189008 Sep 28 08:44:30.222082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 332/630] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:30 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:30.244314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:30.245362 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:30.252722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:30.253246 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:30.253689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:30.254402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:30.254955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:30.255390 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:30.403401 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:30.411425 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b4b93ec2-56e5-4fb7-842c-555cce958ad7 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.176371 Sep 28 08:44:30.412004 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 299/631] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:30 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:30.648013 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:30.648721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:30.654815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:30.655398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:30.655921 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:30.656679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:30.657227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:30.657714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:30.719376 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:30.727054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e4123090-6112-4c36-855d-88c0cf2e7d8f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1613 microversion: 2.1 time: 0.082853 Sep 28 08:44:30.727715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 333/632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:30 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1613 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:31.247875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:31.248428 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:31.254842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:31.255322 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:31.255754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:31.256432 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:31.256887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:31.257333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:31.401623 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:31.410309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-51e66023-3587-4b94-b065-cffa45d1c5d8 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.166141 Sep 28 08:44:31.411041 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 300/633] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:31 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:31.435799 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:31.436480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:31.443556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:31.443996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:31.444216 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:31.445167 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:31.446345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:31.446345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:31.595096 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:31.603055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-383a4c5f-74b5-4136-9b7d-a82b82755144 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.171132 Sep 28 08:44:31.603634 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 334/634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:31 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:31.750191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:31.750961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:31.756848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:31.757371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:31.757810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:31.758510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:31.758967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:31.759399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:31.791777 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:31.792268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:31.793329 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:31.793852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lazy-loading 'fault' on Instance uuid 1d333fe6-3d16-47c6-9104-714c67456652 {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:44:31.836682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:31.844887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ac3196cb-2a5f-4190-82a4-4303466f4c0e tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 200 len: 1331 microversion: 2.1 time: 0.098517 Sep 28 08:44:31.845487 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 301/635] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:31 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:32.434414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:32.434933 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:32.441306 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.441887 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.442196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.442873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.443315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.443731 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.582083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:32.590093 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-30b92897-0589-41a2-91a9-5c388fd2fcbb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.160112 Sep 28 08:44:32.590656 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 335/636] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:32 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:32.627918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:32.628567 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:32.635177 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.635664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.636107 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.636825 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.637328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.637763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.770351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:32.778055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-38443623-3317-40b9-948c-261eaeeb356f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1506 microversion: 2.1 time: 0.154002 Sep 28 08:44:32.778623 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 302/637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:32 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:32.800890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:32.801527 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:32.807414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.807960 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.809037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.809731 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.810185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.810623 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.867766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:32.868622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:32.875867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.876360 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.876804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.877531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:32.877993 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:32.878421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:32.891770 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 HTTP/1.1 Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:44:32.893447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:44:32.894941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '1d333fe6-3d16-47c6-9104-714c67456652'} Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:44:32.895733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:44:32.896860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:44:32.897915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:44:32.897915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2b6927a5-100a-489b-8cd1-be81cae79947 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 404 len: 111 microversion: 2.1 time: 0.030883 Sep 28 08:44:32.897915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 303/638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:32 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 08:44:32.899668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127111) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 08:44:32.903416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3df587e7-ad7e-4090-a95c-154c880e843c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '.version_select at 0x7f984fbfa5e0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:32.930456 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3df587e7-ad7e-4090-a95c-154c880e843c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-174439730" status: 202 len: 0 microversion: 2.1 time: 0.030150 Sep 28 08:44:32.931276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 304/639] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 08:44:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-174439730 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:44:32.977270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [cdcc8d9b-53db-43ac-837a-634e6811f27b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 08:44:33.593707 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-76175d42-330a-42c7-b06e-26437bbd2c40 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: .version_select at 0x7f984fcc23a0>, body: {"keypair": {"name": "tempest-keypair-74461129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAZm9eP2/oqzDyF6u6KGe/cv5t/EZMtap34JIoR1elsym3TTv+S78Gn3Joh0mfQS8t16/mFpB03JU5U6ViwquP421vrdOs6XEU97RIOTwX7XLaBBB21Vv0my1T6vjgnCQ=="}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:33.610064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-76175d42-330a-42c7-b06e-26437bbd2c40 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:44:33.613903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-76175d42-330a-42c7-b06e-26437bbd2c40 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:44:33.635428 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-76175d42-330a-42c7-b06e-26437bbd2c40 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046231 Sep 28 08:44:33.637011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 305/640] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:44:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:44:33.641006 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:33.641645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:33.647618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:33.648111 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:33.648551 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:33.649828 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:33.650289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:33.650719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:33.846329 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:33.856862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0e411dee-3fc1-49d2-a6a8-451799b756fb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1677 microversion: 2.1 time: 0.218730 Sep 28 08:44:33.858020 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 306/641] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:33 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:33.985589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO oslo.messaging._drivers.impl_rabbit [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [cdcc8d9b-53db-43ac-837a-634e6811f27b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 52010. Sep 28 08:44:33.988754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c1815716-78ba-48f9-a7bd-080e5c79ac48 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "POST /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010/action" status: 202 len: 0 microversion: 2.1 time: 1.191759 Sep 28 08:44:33.992611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 336/642] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:44:32 2022] POST /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010/action => generated 0 bytes in 1196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:44:33.997978 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:34.001636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:34.011697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:34.021848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:34.022313 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:34.023061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:34.023535 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:34.024195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:34.222590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:34.230717 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-dfff3ab2-5231-4b94-a54d-097093930190 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1514 microversion: 2.1 time: 0.236520 Sep 28 08:44:34.248962 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 307/643] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:33 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:34.883524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:34.884219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:34.892928 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:34.893584 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:34.894142 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:34.895337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:34.895789 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:34.896440 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:35.104150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:35.112342 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6ec3fa7d-de3b-4c8a-950a-0d51a869f706 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1654 microversion: 2.1 time: 0.234192 Sep 28 08:44:35.116424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 337/644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:34 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1654 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:35.137056 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c9daf4b3-2027-4283-82b3-0566034ed0ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:35.143349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c9daf4b3-2027-4283-82b3-0566034ed0ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:35.143837 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c9daf4b3-2027-4283-82b3-0566034ed0ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:35.144259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c9daf4b3-2027-4283-82b3-0566034ed0ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:35.167144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c9daf4b3-2027-4283-82b3-0566034ed0ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Going to try to start instance {{(pid=127110) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 28 08:44:35.219733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c9daf4b3-2027-4283-82b3-0566034ed0ca tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action" status: 202 len: 0 microversion: 2.1 time: 0.086691 Sep 28 08:44:35.224656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 308/645] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:44:35 2022] POST /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:44:35.230800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:35.231559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:35.245043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:35.246195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:35.246830 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:35.247535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:35.247985 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:35.248902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:35.260155 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:35.262600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:35.274009 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:35.275042 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:35.275899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:35.277166 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:35.277979 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:35.278627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:35.600855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:35.605656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:35.610951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b6dee76d-f4d5-499f-99fe-b1653985ea60 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1663 microversion: 2.1 time: 0.384915 Sep 28 08:44:35.612042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 338/646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:35 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1663 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:35.627920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2ba105ad-4fa6-4d30-bc55-1bbe455441ca tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1516 microversion: 2.1 time: 0.374654 Sep 28 08:44:35.628511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 309/647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:35 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1516 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:35.636639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1243237997", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5328add-2390-4470-bd9d-0ff97db6e42c"}], "security_groups": [{"name": "tempest-securitygroup--83466896"}], "key_name": "tempest-keypair-74461129", "user_data": "}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:35.699904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-a0eb550b-f014-4c91-a800-fdfce3b052f8 req-4917b364-ddba-49d2-99c4-e76cc9635bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901f2acc-6433-42cb-a931-82ccde824010", "name": "network-vif-unplugged", "status": "completed", "tag": "ed5b6be5-cf6e-47ab-9c77-e942a22429de"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:35.714101 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-a0eb550b-f014-4c91-a800-fdfce3b052f8 req-4917b364-ddba-49d2-99c4-e76cc9635bc4 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:35.714685 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-a0eb550b-f014-4c91-a800-fdfce3b052f8 req-4917b364-ddba-49d2-99c4-e76cc9635bc4 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:35.715180 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-a0eb550b-f014-4c91-a800-fdfce3b052f8 req-4917b364-ddba-49d2-99c4-e76cc9635bc4 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:35.732999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.compute.server_external_events [req-a0eb550b-f014-4c91-a800-fdfce3b052f8 req-4917b364-ddba-49d2-99c4-e76cc9635bc4 service nova] Unable to find a host for instance 901f2acc-6433-42cb-a931-82ccde824010. Dropping event network-vif-unplugged {{(pid=127111) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 28 08:44:35.734069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-a0eb550b-f014-4c91-a800-fdfce3b052f8 req-4917b364-ddba-49d2-99c4-e76cc9635bc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.120918 Sep 28 08:44:35.734935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 339/648] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 122 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 28 08:44:35.805262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] validate_networks() for [('b5328add-2390-4470-bd9d-0ff97db6e42c', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:44:36.355176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:44:36.355758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:44:36.356212 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:44:36.356770 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:44:36.357216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:44:36.365800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:36.366306 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:36.366766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:36.367585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:36.368042 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:36.368467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:36.377053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:36.389819 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:44:36.396679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:44:36.406121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:44:36.408565 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:44:36.423644 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:36.462222 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1db27a58-e11b-4edc-9ca1-d36d052ee3c7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.832663 Sep 28 08:44:36.462870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 310/649] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:44:35 2022] POST /compute/v2.1/servers => generated 400 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:44:36.474083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8d412a11-32e5-4aae-bd78-12a063e14020 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:36.474728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8d412a11-32e5-4aae-bd78-12a063e14020 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:36.560358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8d412a11-32e5-4aae-bd78-12a063e14020 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:36.567825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8d412a11-32e5-4aae-bd78-12a063e14020 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1240 microversion: 2.1 time: 0.097382 Sep 28 08:44:36.568492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 340/650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:36 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:36.639946 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:36.640698 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:36.648139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:36.648976 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:36.649652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:36.650554 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:36.651078 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:36.652260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:36.653049 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:36.653811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:36.660948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:36.661677 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:36.662280 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:36.663141 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:36.663881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:36.664491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:36.961591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:36.964559 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:36.970661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c742bfa6-5503-43e7-946c-a6dfe954ef2d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.322645 Sep 28 08:44:36.971602 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 341/651] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:36 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:36.973172 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6b59c04c-ca6e-4731-9e98-0e57c1a35451 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1663 microversion: 2.1 time: 0.337647 Sep 28 08:44:36.973762 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 311/652] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:36 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1663 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:37.591740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:37.592772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:37.600163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:37.601024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:37.601565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:37.602353 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:37.603025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:37.603546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:37.681150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:37.689562 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f1df8570-1e64-4a36-9a37-810e51480863 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1236 microversion: 2.1 time: 0.102424 Sep 28 08:44:37.690135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 342/653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:37 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:37.994066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:37.994676 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:37.996454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:37.997064 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:38.001836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:38.002331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:38.002765 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:38.002950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:38.003431 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:38.003575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:38.003859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:38.003966 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:38.004308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:38.004549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:38.005003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:38.005453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:38.023206 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:38.199904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:38.203327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:38.207774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6bf30f08-90b2-4eb7-9de7-db7937440ee6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1667 microversion: 2.1 time: 0.215732 Sep 28 08:44:38.208346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 343/654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:37 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1667 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:38.211180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-eac6cfb2-9ab9-4ae0-9f38-343b25e9746d tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.221008 Sep 28 08:44:38.211881 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 312/655] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:37 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:38.713205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:38.713823 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:38.720736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:38.721264 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:38.721706 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:38.722424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:38.722863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:38.723289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:38.785441 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:38.793233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d2cd664c-1eaa-4c36-875d-c7e36fc62f2c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1292 microversion: 2.1 time: 0.083909 Sep 28 08:44:38.793818 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 344/656] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:38 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:39.236107 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:39.237564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:39.244276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:39.244763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:39.245741 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:39.246461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:39.246917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:39.247341 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:39.431162 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:39.439562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-26a72926-2f64-4204-8212-3d8f8c2df5a2 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.207431 Sep 28 08:44:39.440118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 313/657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:39 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:39.815911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:39.816437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:39.822813 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:39.823287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:39.824270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:39.824966 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:39.825444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:39.825859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:39.899936 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:39.907572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7a42a9e5-c786-4c7d-8e1a-a94dacbe2eaa tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1298 microversion: 2.1 time: 0.095534 Sep 28 08:44:39.908128 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 345/658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:39 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:40.462868 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:40.463475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:40.470575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:40.471069 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:40.471508 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:40.472213 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:40.472672 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:40.473117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:40.667388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:40.675375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-529f0ff3-7c06-4be2-8931-25a0c7f7947a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.216483 Sep 28 08:44:40.675939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 314/659] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:40 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:40.803809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-fc989c30-5f1d-4572-b2a0-1fe1f0b22bd5 req-666d3a88-eb45-479b-86b1-eb6fd8c0a1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ab421e-2f19-43f0-8732-27ded4ece5d7", "tag": "0394e60a-0854-4093-8091-63c585ef8d20"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:40.815664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-fc989c30-5f1d-4572-b2a0-1fe1f0b22bd5 req-666d3a88-eb45-479b-86b1-eb6fd8c0a1aa service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:40.816426 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-fc989c30-5f1d-4572-b2a0-1fe1f0b22bd5 req-666d3a88-eb45-479b-86b1-eb6fd8c0a1aa service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:40.817544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-fc989c30-5f1d-4572-b2a0-1fe1f0b22bd5 req-666d3a88-eb45-479b-86b1-eb6fd8c0a1aa service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:40.831618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-fc989c30-5f1d-4572-b2a0-1fe1f0b22bd5 req-666d3a88-eb45-479b-86b1-eb6fd8c0a1aa service nova] Creating event network-changed:0394e60a-0854-4093-8091-63c585ef8d20 for instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 on hv-cinder-84456 Sep 28 08:44:40.836857 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-fc989c30-5f1d-4572-b2a0-1fe1f0b22bd5 req-666d3a88-eb45-479b-86b1-eb6fd8c0a1aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036760 Sep 28 08:44:40.837644 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 346/660] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:40.930286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:40.930826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:40.937436 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:40.937917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:40.938348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:40.939033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:40.939506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:40.939926 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:41.134481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:41.142640 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c8d6c5a4-1f41-47b9-b687-ddd49d81e695 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1364 microversion: 2.1 time: 0.216252 Sep 28 08:44:41.143322 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 315/661] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:40 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:44:41.699613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:41.700330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:41.706432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:41.706913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:41.707344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:41.708032 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:41.708483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:41.708902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:42.107477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:42.115212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d707f256-7329-441c-969c-ba19f9a81a3f tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.420008 Sep 28 08:44:42.115774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 347/662] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:41 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:42.165758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:42.166364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:42.173683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:42.174163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:42.174599 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:42.175285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:42.175733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:42.176153 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:42.307713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:42.315307 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4c497fcf-c6c1-43b8-9a52-9d4060762966 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1364 microversion: 2.1 time: 0.153382 Sep 28 08:44:42.315858 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 316/663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:42 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:43.137943 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:43.138557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:43.145225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:43.145712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:43.146153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:43.146843 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:43.147299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:43.147725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:43.279769 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:43.287809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-69312cef-ae2e-4f7d-a902-953f9e4a7898 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.153978 Sep 28 08:44:43.288375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 348/664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:43 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:43.337816 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:43.338424 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:43.344750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:43.345342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:43.345778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:43.346486 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:43.346931 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:43.347358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:43.482602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:43.490700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7290cbd4-9456-40d4-9190-610d74ec8fcd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1364 microversion: 2.1 time: 0.156765 Sep 28 08:44:43.491349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 317/665] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:43 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:44.311446 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:44.312057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:44.318054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:44.318543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:44.318980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:44.319672 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:44.320127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:44.320555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:44.481166 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:44.489128 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-053e5314-32b6-49fe-bc3c-a57bd06f3f41 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.181851 Sep 28 08:44:44.489695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 349/666] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:44 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:44.513824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:44.514541 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:44.521076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:44.521588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:44.522017 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:44.522709 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:44.523158 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:44.523581 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:44.651452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:44.659364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d291447e-a1a3-4c7b-b510-e645942fb3b9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1364 microversion: 2.1 time: 0.149462 Sep 28 08:44:44.659914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 318/667] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:44 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:45.389675 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-c05ed67a-cb79-42f4-885c-75fba4fb5095 req-0d780575-7968-4d6b-869b-14a96973b002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ab421e-2f19-43f0-8732-27ded4ece5d7", "name": "network-vif-plugged", "status": "completed", "tag": "0394e60a-0854-4093-8091-63c585ef8d20"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:45.401111 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c05ed67a-cb79-42f4-885c-75fba4fb5095 req-0d780575-7968-4d6b-869b-14a96973b002 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:45.401633 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c05ed67a-cb79-42f4-885c-75fba4fb5095 req-0d780575-7968-4d6b-869b-14a96973b002 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:45.402442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c05ed67a-cb79-42f4-885c-75fba4fb5095 req-0d780575-7968-4d6b-869b-14a96973b002 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:45.413600 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-c05ed67a-cb79-42f4-885c-75fba4fb5095 req-0d780575-7968-4d6b-869b-14a96973b002 service nova] Creating event network-vif-plugged:0394e60a-0854-4093-8091-63c585ef8d20 for instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 on hv-cinder-84456 Sep 28 08:44:45.419248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-c05ed67a-cb79-42f4-885c-75fba4fb5095 req-0d780575-7968-4d6b-869b-14a96973b002 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 Sep 28 08:44:45.420113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 350/668] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:44:45.512077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:45.512689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:45.519396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:45.520528 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:45.520965 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:45.521700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:45.522152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:45.522579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:45.658278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:45.665962 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-cf96ea04-b84e-4081-b65d-666993d1120a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.157783 Sep 28 08:44:45.666525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 319/669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:45 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:45.682205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:45.683631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:45.690029 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:45.690610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:45.691060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:45.691763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:45.692220 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:45.692648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:45.847935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:45.856592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7c41e53a-34a6-4075-8051-c9962d8faae3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1364 microversion: 2.1 time: 0.178478 Sep 28 08:44:45.857173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 351/670] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:45 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:46.689463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:46.690113 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:46.691896 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:46.692570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=10 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:46.699421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:46.699905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:46.700340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:46.701156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:46.701616 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:46.702033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:46.844072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:46.851773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7350a225-dbf8-4545-b4d7-77971d6b166c tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.166304 Sep 28 08:44:46.852388 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 320/671] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:46 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:46.884306 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:46.885154 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:46.888510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:46.892776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:46.893319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:46.893755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:46.894474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:46.894927 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:46.895349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:47.021816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:47.029482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dd7d4d8d-ccd7-4b36-ae26-3d9cff385c69 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1364 microversion: 2.1 time: 0.149650 Sep 28 08:44:47.029977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 352/672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:46 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:47.875934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:47.876513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:47.882879 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:47.883350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:47.883774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:47.884448 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:47.884900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:47.885340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:48.017730 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:48.025497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-170302ad-18dc-472d-922c-17ead383d3fb tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.153414 Sep 28 08:44:48.026074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 321/673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:47 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:48.053443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:48.054061 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:48.056377 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:44:48.062285 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:48.062772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:48.063207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:48.063901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:48.064351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:48.064782 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:48.207272 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:48.215298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c16d8e13-2d44-490d-beab-8758be701f21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1553 microversion: 2.1 time: 0.165561 Sep 28 08:44:48.216332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 353/674] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:48 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:48.238313 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:48.238810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:48.244540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:48.245954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:48.246389 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:48.247250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:48.247709 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:48.248158 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:48.331262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e0ef64e0-1266-4e1f-853c-c9fd372f1629 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096931 Sep 28 08:44:48.331847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 322/675] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:44:48 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:49.049136 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:49.049658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:49.055572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:49.056135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:49.056476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:49.057185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:49.057654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:49.058058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:49.194354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:49.203298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8847138e-2ef6-4cbf-b45f-db13685f9089 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.158428 Sep 28 08:44:49.203861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 354/676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:49 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:49.392824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-791b590c-a23c-40be-ba94-0a623c6e2332 req-d806fa31-1be6-4196-871c-25b745f7e37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901f2acc-6433-42cb-a931-82ccde824010", "name": "network-vif-plugged", "status": "completed", "tag": "ed5b6be5-cf6e-47ab-9c77-e942a22429de"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:49.404432 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-791b590c-a23c-40be-ba94-0a623c6e2332 req-d806fa31-1be6-4196-871c-25b745f7e37b service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:49.405024 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-791b590c-a23c-40be-ba94-0a623c6e2332 req-d806fa31-1be6-4196-871c-25b745f7e37b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:49.405484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-791b590c-a23c-40be-ba94-0a623c6e2332 req-d806fa31-1be6-4196-871c-25b745f7e37b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:49.417435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-791b590c-a23c-40be-ba94-0a623c6e2332 req-d806fa31-1be6-4196-871c-25b745f7e37b service nova] Creating event network-vif-plugged:ed5b6be5-cf6e-47ab-9c77-e942a22429de for instance 901f2acc-6433-42cb-a931-82ccde824010 on hv-cinder-84456 Sep 28 08:44:49.423143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-791b590c-a23c-40be-ba94-0a623c6e2332 req-d806fa31-1be6-4196-871c-25b745f7e37b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033759 Sep 28 08:44:49.424502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 323/677] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:49.568716 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-19fd943b-7dd6-4d22-842f-5f8509adabae req-1ee9dae5-118b-4df7-80c3-93e10b973feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ab421e-2f19-43f0-8732-27ded4ece5d7", "tag": "0394e60a-0854-4093-8091-63c585ef8d20"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:44:49.578895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-19fd943b-7dd6-4d22-842f-5f8509adabae req-1ee9dae5-118b-4df7-80c3-93e10b973feb service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:49.579378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-19fd943b-7dd6-4d22-842f-5f8509adabae req-1ee9dae5-118b-4df7-80c3-93e10b973feb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:49.579811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-19fd943b-7dd6-4d22-842f-5f8509adabae req-1ee9dae5-118b-4df7-80c3-93e10b973feb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:49.591558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-19fd943b-7dd6-4d22-842f-5f8509adabae req-1ee9dae5-118b-4df7-80c3-93e10b973feb service nova] Creating event network-changed:0394e60a-0854-4093-8091-63c585ef8d20 for instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 on hv-cinder-84456 Sep 28 08:44:49.597399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-19fd943b-7dd6-4d22-842f-5f8509adabae req-1ee9dae5-118b-4df7-80c3-93e10b973feb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095071 Sep 28 08:44:49.597979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 355/678] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:44:50.228405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:50.229135 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:50.235363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:50.235855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:50.236293 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:50.237002 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:50.237484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:50.237917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:50.407774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:50.415862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3020424a-c1a4-4f0b-9a2f-abe833ff8b05 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1572 microversion: 2.1 time: 0.191633 Sep 28 08:44:50.416336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 324/679] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:50 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1572 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:44:51.441532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:44:51.442348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:44:51.448915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:51.449494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:51.450063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:51.450800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:44:51.451249 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:44:51.451672 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:44:51.586638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:44:51.594360 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-534f6d52-aee0-4eb5-b581-68a4a515bdfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1559 microversion: 2.1 time: 0.158168 Sep 28 08:44:51.594915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 356/680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:44:51 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:02.995035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:02.995597 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:02.998070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=28 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:02.998868 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=78 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:03.004830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:03.005340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:03.005769 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:03.006471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:03.006897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:03.007314 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:03.087742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'services' on Instance uuid fde027c2-5ced-4b17-abcd-d13aae06a1aa {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:45:03.158251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6fc3c430-8bd4-48a0-9811-536dfc32ec21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments/cd8eeb76-0b57-4d24-ae2e-0e50ab1fa350" status: 202 len: 0 microversion: 2.1 time: 0.167114 Sep 28 08:45:03.158840 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 325/681] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:45:02 2022] DELETE /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments/cd8eeb76-0b57-4d24-ae2e-0e50ab1fa350 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:45:03.168207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:03.172484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:03.176613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=7 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:03.177529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=68 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:03.183394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:03.184214 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:03.184708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:03.185552 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:03.186123 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:03.186657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:03.220522 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5390fc62-1009-41ef-9212-3862110e340e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057012 Sep 28 08:45:03.221143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 357/682] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:45:03 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:45:04.235227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:04.237594 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:04.243928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:04.244414 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:04.244852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:04.245641 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:04.246092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:04.246511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:04.277115 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ed49351b-a61b-4d8a-992a-92567bae8b21 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046171 Sep 28 08:45:04.277666 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 326/683] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:45:04 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:05.288852 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:05.291040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:05.298223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.298703 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.299135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.299815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.300265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.300680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.330198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-92dfb624-9a3e-4df0-8e92-b4ec6972ee70 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045277 Sep 28 08:45:05.330746 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 358/684] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:45:05 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 28 08:45:05.411173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:05.411684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:05.417958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.418448 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.418886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.419575 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.420294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.420719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.445527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:45:05.523502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-783c17c2-4314-4856-ab24-3f9731985a80 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 204 len: 0 microversion: 2.1 time: 0.115516 Sep 28 08:45:05.527646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 327/685] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:45:05 2022] DELETE /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:45:05.532971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:05.533613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:05.539695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.540129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.540543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.541274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.541728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.542824 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.674460 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:05.681906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1ca02318-f36c-4257-91ad-74ddc2572e51 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1687 microversion: 2.1 time: 0.152862 Sep 28 08:45:05.682474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 359/686] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:05 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:05.732210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:05.732878 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:05.738732 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.739218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.739656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.740338 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.740788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.741249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.770220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6954239a-8312-4261-a7a0-e052d54f5141 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments/5f177a2e-8b3b-41ea-aeaf-4c07c9835e3c" status: 200 len: 194 microversion: 2.20 time: 0.042404 Sep 28 08:45:05.770810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 328/687] 10.222.0.52 () {60 vars in 1454 bytes} [Wed Sep 28 08:45:05 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments/5f177a2e-8b3b-41ea-aeaf-4c07c9835e3c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:45:05.840685 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:05.841220 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:05.847820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.848300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.848732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.849433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:05.849894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:05.850293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:05.929336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lazy-loading 'services' on Instance uuid 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:45:06.000515 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-aaddd32a-28c8-441d-b73c-43a41acab8b8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments/5f177a2e-8b3b-41ea-aeaf-4c07c9835e3c" status: 202 len: 0 microversion: 2.20 time: 0.163704 Sep 28 08:45:06.001160 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 360/688] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Sep 28 08:45:05 2022] DELETE /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments/5f177a2e-8b3b-41ea-aeaf-4c07c9835e3c => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:45:06.009705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:06.012507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:06.018674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:06.019155 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:06.019589 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:06.020277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:06.020729 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:06.021184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:06.051168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-64bb7377-8a76-4873-90bb-b04729c254d7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044346 Sep 28 08:45:06.052090 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 329/689] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 08:45:06 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:45:06.705863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:06.706567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:06.713223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:06.714427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:06.714808 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:06.715501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:06.715980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:06.716409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:06.847184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:06.854835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8851fd9f-0803-44e7-bc7d-6b5e8b3197aa tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1687 microversion: 2.1 time: 0.153234 Sep 28 08:45:06.855395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 361/690] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:06 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:07.065054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:07.067033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:07.074313 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:07.074848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:07.075236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:07.075938 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:07.076391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:07.076813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:07.106104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d262f173-5e3d-49df-aa85-f262d9e2c519 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045296 Sep 28 08:45:07.106661 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 330/691] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 08:45:07 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:45:07.878449 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:07.879047 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:07.885446 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:07.885928 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:07.886366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:07.887057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:07.887510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:07.887938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:08.015911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:08.023541 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ac3a8aa6-6ee5-42d8-affe-e7918f865983 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1687 microversion: 2.1 time: 0.149023 Sep 28 08:45:08.024131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 362/692] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:07 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:08.118807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:08.121475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:08.127768 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:08.128253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:08.128692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:08.129412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:08.129867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:08.130292 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:08.159249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0efd5d3b-a873-41e7-aa25-20aad648fea7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045003 Sep 28 08:45:08.159805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 331/693] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 08:45:08 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:45:09.047544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:09.048157 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:09.054708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:09.055193 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:09.055630 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:09.056332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:09.056788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:09.057239 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:09.173447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:09.175604 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:09.182034 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:09.183088 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:09.183477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:09.184363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:09.184814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:09.185259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:09.215257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-56626814-7702-4ad5-8591-f9f3d27d9895 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047276 Sep 28 08:45:09.215824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 332/694] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 08:45:09 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 08:45:09.225382 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:09.233011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-597dca4b-ab6a-47b1-a173-e4b7f96bbbe4 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1687 microversion: 2.1 time: 0.189593 Sep 28 08:45:09.233608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 363/695] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:09 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:10.228439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:10.230675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:10.238365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:10.239117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:10.239730 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:10.240619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:10.241260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:10.241849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:10.256294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:10.257609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:10.272551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:10.273407 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:10.274068 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:10.274971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:10.275589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:10.276253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:10.298554 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9a06ff85-975e-49e9-8047-58fde17072ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074158 Sep 28 08:45:10.303282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 333/696] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 08:45:10 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:45:10.522812 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:10.536391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-752fb734-0b72-4ba3-a4e2-a26bb4114721 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1687 microversion: 2.1 time: 0.283932 Sep 28 08:45:10.543958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 364/697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:10 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1687 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:10.924785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-655639c5-42e6-439d-8f33-7170a9b02079 req-b805d8de-0207-4bae-aa51-2b8f185cd7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde027c2-5ced-4b17-abcd-d13aae06a1aa", "name": "network-vif-deleted", "tag": "cd365a60-ac04-41d0-9a07-5370af59c807"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:10.933987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-655639c5-42e6-439d-8f33-7170a9b02079 req-b805d8de-0207-4bae-aa51-2b8f185cd7c9 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:10.934402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-655639c5-42e6-439d-8f33-7170a9b02079 req-b805d8de-0207-4bae-aa51-2b8f185cd7c9 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:10.934827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-655639c5-42e6-439d-8f33-7170a9b02079 req-b805d8de-0207-4bae-aa51-2b8f185cd7c9 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:10.947260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-655639c5-42e6-439d-8f33-7170a9b02079 req-b805d8de-0207-4bae-aa51-2b8f185cd7c9 service nova] Creating event network-vif-deleted:cd365a60-ac04-41d0-9a07-5370af59c807 for instance fde027c2-5ced-4b17-abcd-d13aae06a1aa on hv-cinder-84456 Sep 28 08:45:10.953198 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-655639c5-42e6-439d-8f33-7170a9b02079 req-b805d8de-0207-4bae-aa51-2b8f185cd7c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032016 Sep 28 08:45:10.953808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 334/698] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:11.311416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:11.314729 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:11.321181 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.321674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.322113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.322811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.323267 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.323695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.353910 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ebb04b3e-a94b-4196-b5a0-1acb78b58fbe tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046149 Sep 28 08:45:11.361555 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 365/699] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 08:45:11 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:11.428830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:11.430037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:11.437116 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.437592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.438029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.438727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.439183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.439601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.472020 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:45:11.566429 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:11.567291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:11.568519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c0e3762f-9231-4cbf-8d47-e64c802adb53 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 204 len: 0 microversion: 2.20 time: 0.143313 Sep 28 08:45:11.571248 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 335/700] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 08:45:11 2022] DELETE /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 08:45:11.578310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.578861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.579295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.580218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.580850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:11.581625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.581779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:11.582355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.589331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.589331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.589688 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.590405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.591043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.591620 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.621526 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:11.622019 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:11.622452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:11.622898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'fault' on Instance uuid fde027c2-5ced-4b17-abcd-d13aae06a1aa {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:45:11.695223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:11.705351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9e0fbe33-8905-4237-8233-710cab33bd40 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1334 microversion: 2.1 time: 0.148017 Sep 28 08:45:11.706196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 366/701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:11 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1334 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:11.763467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:11.771772 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:11.773303 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:11.774505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4f4dc266-a43d-415d-975e-c82d9080d309 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.198772 Sep 28 08:45:11.775061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 336/702] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:11 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:45:12.729068 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:12.729738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:12.736612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:12.737105 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:12.737543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:12.738226 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:12.738674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:12.739096 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:12.770469 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:12.770944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:12.771371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:12.771807 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'fault' on Instance uuid fde027c2-5ced-4b17-abcd-d13aae06a1aa {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:45:12.800134 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:12.800681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:12.807060 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:12.807582 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:12.808026 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:12.808720 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:12.809263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:12.809699 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:12.812610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:12.820334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-466dc9b8-eba9-4da8-a42a-c9f4d2000189 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1334 microversion: 2.1 time: 0.095058 Sep 28 08:45:12.820897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 367/703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:12 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1334 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:12.940467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:12.948886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:12.950345 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:12.951504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-900dab9b-3ccf-4ec7-b2ef-6995156c5e48 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.155356 Sep 28 08:45:12.952076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 337/704] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:12 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:45:13.843386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:13.844815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:13.851191 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:13.851682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:13.852142 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:13.852975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:13.855638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:13.856104 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:13.890282 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:13.890991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:13.891583 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:13.892235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'fault' on Instance uuid fde027c2-5ced-4b17-abcd-d13aae06a1aa {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:45:13.942270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:13.951254 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ca8c8204-109e-4542-84a8-2f82025a432f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 200 len: 1334 microversion: 2.1 time: 0.112354 Sep 28 08:45:13.952031 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 368/705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:13 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 1334 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:13.977506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:13.978994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:13.986604 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:13.987091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:13.987526 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:13.988276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:13.989251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:13.989946 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:13.994578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:14.131186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:14.139392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:14.140830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:14.142010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e206eef8-d245-48f8-a4bf-55cfef8510ea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1724 microversion: 2.20 time: 0.168603 Sep 28 08:45:14.142567 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 338/706] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:13 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:14.883348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-01a0d76e-3eb1-4d8f-9965-24052b35d70b req-02e426fc-9fed-4346-8fb7-a7f8470c86de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4", "name": "network-vif-deleted", "tag": "34490fea-8100-40b7-919a-078c2cfc5f1d"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:14.899879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-01a0d76e-3eb1-4d8f-9965-24052b35d70b req-02e426fc-9fed-4346-8fb7-a7f8470c86de service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:14.900774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-01a0d76e-3eb1-4d8f-9965-24052b35d70b req-02e426fc-9fed-4346-8fb7-a7f8470c86de service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:14.903172 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-01a0d76e-3eb1-4d8f-9965-24052b35d70b req-02e426fc-9fed-4346-8fb7-a7f8470c86de service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:14.915709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-01a0d76e-3eb1-4d8f-9965-24052b35d70b req-02e426fc-9fed-4346-8fb7-a7f8470c86de service nova] Creating event network-vif-deleted:34490fea-8100-40b7-919a-078c2cfc5f1d for instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 on hv-cinder-84456 Sep 28 08:45:14.920935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-01a0d76e-3eb1-4d8f-9965-24052b35d70b req-02e426fc-9fed-4346-8fb7-a7f8470c86de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041435 Sep 28 08:45:14.921570 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 369/707] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:14.976510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:14.977119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: fde027c2-5ced-4b17-abcd-d13aae06a1aa] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:14.983630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:14.984229 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:14.984673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:14.985468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:14.985991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:14.986493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:15.000614 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] HTTP exception thrown: Instance fde027c2-5ced-4b17-abcd-d13aae06a1aa could not be found. Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Request method failure captured: Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa HTTP/1.1 Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf1E8anRpf9Y3Phr433YXemtTmRCIPS0gN4YK9hNtuYt44jxbho8BovV3qNnp3m2RFR2ibzPeasINTLiedCt52ce5SAyNjwFYwpWLPhGBJqSFGpHL1zJfQbGgFFriB_YBnLHbC80pjy61XCtUIULs1ZgDjNtyRekNy3hLZpD_ANccU Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:45:15.002396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42699952850d49fdafb670aeb5f613ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7d712e201f2c47a8a48b6e24559e0d60 Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance fde027c2-5ced-4b17-abcd-d13aae06a1aa could not be found. Sep 28 08:45:15.004018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'fde027c2-5ced-4b17-abcd-d13aae06a1aa'} Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde027c2-5ced-4b17-abcd-d13aae06a1aa could not be found. Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:45:15.004918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde027c2-5ced-4b17-abcd-d13aae06a1aa could not be found. Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde027c2-5ced-4b17-abcd-d13aae06a1aa could not be found. Sep 28 08:45:15.006416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:15.007664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Returning 404 to user: Instance fde027c2-5ced-4b17-abcd-d13aae06a1aa could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:45:15.007664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4bd3a112-a245-4beb-b9fa-52e57ee4f160 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa" status: 404 len: 111 microversion: 2.1 time: 0.032686 Sep 28 08:45:15.007664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 339/708] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:14 2022] GET /compute/v2.1/servers/fde027c2-5ced-4b17-abcd-d13aae06a1aa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:45:15.016424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-13a86421-8905-4796-84ae-634348db3c2e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '.version_select at 0x7f984fb16dc0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:15.040176 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-13a86421-8905-4796-84ae-634348db3c2e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-823050227" status: 202 len: 0 microversion: 2.1 time: 0.027730 Sep 28 08:45:15.040865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 370/709] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 08:45:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-823050227 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:45:15.168840 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:15.170273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:15.177382 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:15.178188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:15.178636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:15.179372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:15.180302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:15.181203 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:15.224373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:15.224976 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:15.225684 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:15.226270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lazy-loading 'fault' on Instance uuid 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:45:15.298087 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:15.310983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:15.312864 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:15.314905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ef74c677-f88d-4607-aa17-a66ff721ae69 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 200 len: 1371 microversion: 2.20 time: 0.150774 Sep 28 08:45:15.316519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 340/710] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:15 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:16.342224 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:16.343009 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:16.349174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:16.349663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:16.350097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:16.350793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:16.351248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:16.351675 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:16.366340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] HTTP exception thrown: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Request method failure captured: Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 HTTP/1.1 Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAhxSddb8QjztshJzvf4vr94QsmkUjOKtWhUzn1rEe7T7xBEpQOyWVyO3xKpcxxgTH8an0rI4nsplzwSA8BPHRgh9QxiFzACiqdxvJzYwAOfczz3YuP6Vix50hDHgHNzgafbJMPmpcPAJjf887o2blb_o2m-jDDNR4ZHQNEB75rpWIY Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:45:16.367975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c067f1df3c7f47299bc2db03d904d156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: b0cbf49cfca74838bee4c8162dfe27ef Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:45:16.369682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4'} Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:45:16.371381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:45:16.372661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:16.374185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Returning 404 to user: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:45:16.374185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a11121be-3f4d-45ef-a750-fc01258fae7c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 404 len: 111 microversion: 2.20 time: 0.032354 Sep 28 08:45:16.374185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 371/711] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:16 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:45:16.378473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-627e01d6-ddfe-480f-ab26-7c19e92d3a1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '.version_select at 0x7f984fbf5c10>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:16.397504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-627e01d6-ddfe-480f-ab26-7c19e92d3a1a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791126393" status: 204 len: 0 microversion: 2.20 time: 0.022744 Sep 28 08:45:16.398064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 341/712] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Sep 28 08:45:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1791126393 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 08:45:17.040187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2c700634-0656-4ebe-bfd3-c073e7a4f7cf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'create', calling method: .version_select at 0x7f984fb26940>, body: {"keypair": {"name": "tempest-keypair-294159261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55bCyUO04zogO7FfM6QKCgM8T0zdVbJEX3W2xVhqUIgsI5gVERUkWGb3vTLGWg/SAkMgcC9VnZ3vceNT8f87tsODF/PJVE5KTISqB8YLhva5k3wIzkq3WOFAFGqzZVzA=="}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:17.056614 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-2c700634-0656-4ebe-bfd3-c073e7a4f7cf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for project c067f1df3c7f47299bc2db03d904d156. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:45:17.064015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-2c700634-0656-4ebe-bfd3-c073e7a4f7cf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for user b0cbf49cfca74838bee4c8162dfe27ef and project c067f1df3c7f47299bc2db03d904d156. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:45:17.088820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2c700634-0656-4ebe-bfd3-c073e7a4f7cf tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052653 Sep 28 08:45:17.089586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 372/713] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Sep 28 08:45:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 28 08:45:18.036566 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:18.037325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:18.042735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:18.043233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:18.043675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:18.044370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:18.044826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:18.045530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:18.071713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:45:18.156948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-90377465-b8d8-48c6-8400-03d84e6c1cbe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 204 len: 0 microversion: 2.1 time: 0.124597 Sep 28 08:45:18.157804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 342/714] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:45:18 2022] DELETE /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:45:18.166416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:18.168228 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:18.175705 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:18.176197 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:18.176643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:18.177374 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:18.177833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:18.178267 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:18.318543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:18.329206 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1b5f44e0-ae95-4aaa-b0af-00313f9132b3 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1508 microversion: 2.1 time: 0.166166 Sep 28 08:45:18.329925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 373/715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:18 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:18.455148 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-509822461", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8e213c79-0ba4-458e-84ef-70d744799a89"}], "security_groups": [{"name": "tempest-securitygroup--1699005472"}], "key_name": "tempest-keypair-294159261", "user_data": "}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:18.560562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] validate_networks() for [('8e213c79-0ba4-458e-84ef-70d744799a89', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:45:18.939936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:45:18.940336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:45:18.940804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:45:18.941242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:45:18.941649 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:45:18.950875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:18.951347 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:18.951774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:18.952492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:18.952935 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:18.953379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:18.971372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for project c067f1df3c7f47299bc2db03d904d156. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:45:18.975644 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Getting quotas for user b0cbf49cfca74838bee4c8162dfe27ef and project c067f1df3c7f47299bc2db03d904d156. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:45:18.990040 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:45:18.992831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:45:19.058993 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2e184c78-d649-4a64-8b03-e49af49f7a38 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.657079 Sep 28 08:45:19.065843 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 343/716] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Sep 28 08:45:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 28 08:45:19.071063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f9f6e612-7d2b-4f3f-83ee-1e0264440f0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:19.072038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f9f6e612-7d2b-4f3f-83ee-1e0264440f0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:19.151066 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f9f6e612-7d2b-4f3f-83ee-1e0264440f0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:19.159290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f9f6e612-7d2b-4f3f-83ee-1e0264440f0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:19.160951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f9f6e612-7d2b-4f3f-83ee-1e0264440f0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:19.162447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f9f6e612-7d2b-4f3f-83ee-1e0264440f0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1280 microversion: 2.20 time: 0.095198 Sep 28 08:45:19.163289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 374/717] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:19 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:19.352644 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:19.353578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:19.360642 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:19.361299 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:19.361967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:19.362750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:19.364150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:19.364794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:19.534127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:19.542707 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7e3923e9-8465-405e-b7b8-1baedf12d6f7 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1508 microversion: 2.1 time: 0.194186 Sep 28 08:45:19.543372 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 344/718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:19 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:45:19.624526 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-c2dbf819-db40-428e-89d2-52eeed0696f7 req-61a2fd6f-8844-4bfe-b9c6-e169a313b13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d58d7457-5855-4349-876d-c208e237594e", "name": "network-vif-deleted", "tag": "6a3b0562-aa67-4f66-a0ad-66e753e42296"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:19.636765 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c2dbf819-db40-428e-89d2-52eeed0696f7 req-61a2fd6f-8844-4bfe-b9c6-e169a313b13e service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:19.637286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c2dbf819-db40-428e-89d2-52eeed0696f7 req-61a2fd6f-8844-4bfe-b9c6-e169a313b13e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:19.637707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c2dbf819-db40-428e-89d2-52eeed0696f7 req-61a2fd6f-8844-4bfe-b9c6-e169a313b13e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:19.649355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-c2dbf819-db40-428e-89d2-52eeed0696f7 req-61a2fd6f-8844-4bfe-b9c6-e169a313b13e service nova] Creating event network-vif-deleted:6a3b0562-aa67-4f66-a0ad-66e753e42296 for instance d58d7457-5855-4349-876d-c208e237594e on hv-cinder-84456 Sep 28 08:45:19.657288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-c2dbf819-db40-428e-89d2-52eeed0696f7 req-61a2fd6f-8844-4bfe-b9c6-e169a313b13e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035940 Sep 28 08:45:19.658561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 375/719] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:20.188618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:20.189186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:20.195648 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:20.196127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:20.196552 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:20.197273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:20.198252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:20.198628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:20.264015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:20.272012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:20.273487 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:20.274589 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-133e3144-5f4c-477d-b83b-d117565d6669 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1332 microversion: 2.20 time: 0.089995 Sep 28 08:45:20.275131 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 345/720] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:20 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:20.569628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:20.570526 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:20.578486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:20.579133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:20.579842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:20.580641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:20.581320 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:20.581806 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:20.618253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:20.618815 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:20.619315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:20.620618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lazy-loading 'fault' on Instance uuid d58d7457-5855-4349-876d-c208e237594e {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:45:20.626773 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:20.670806 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:20.679322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b77673f9-a00d-411e-a5c2-d0f43dd217d6 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 200 len: 1312 microversion: 2.1 time: 0.115133 Sep 28 08:45:20.679879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 376/721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:20 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:21.299761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:21.301713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:21.308893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.309666 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.310108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.310820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.311307 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.311727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.454464 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:21.462623 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:21.464099 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:21.465241 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-32362dbc-2769-44a3-974e-5d4ee9c85fb3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.169742 Sep 28 08:45:21.465804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 346/722] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:21 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:21.702319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:21.702981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: d58d7457-5855-4349-876d-c208e237594e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:21.709402 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.709889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.710326 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.711021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.711474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.711898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.726404 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] HTTP exception thrown: Instance d58d7457-5855-4349-876d-c208e237594e could not be found. Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Request method failure captured: Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e HTTP/1.1 Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf1E8anRpf9Y3Phr433YXemtTmRCIPS0gN4YK9hNtuYt44jxbho8BovV3qNnp3m2RFR2ibzPeasINTLiedCt52ce5SAyNjwFYwpWLPhGBJqSFGpHL1zJfQbGgFFriB_YBnLHbC80pjy61XCtUIULs1ZgDjNtyRekNy3hLZpD_ANccU Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:45:21.728082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42699952850d49fdafb670aeb5f613ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7d712e201f2c47a8a48b6e24559e0d60 Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance d58d7457-5855-4349-876d-c208e237594e could not be found. Sep 28 08:45:21.729694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'd58d7457-5855-4349-876d-c208e237594e'} Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d58d7457-5855-4349-876d-c208e237594e could not be found. Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:45:21.733616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d58d7457-5855-4349-876d-c208e237594e could not be found. Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d58d7457-5855-4349-876d-c208e237594e could not be found. Sep 28 08:45:21.734993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:21.736288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Returning 404 to user: Instance d58d7457-5855-4349-876d-c208e237594e could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:45:21.736288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-654472a5-d49d-4c3a-b118-2dc88c90429b tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e" status: 404 len: 111 microversion: 2.1 time: 0.031791 Sep 28 08:45:21.736288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 377/723] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:21 2022] GET /compute/v2.1/servers/d58d7457-5855-4349-876d-c208e237594e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:45:21.738479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:21.738898 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:21.745140 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.745997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.746146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.746732 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.747177 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.747600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.772821 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:45:21.853043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-92fec31d-3e9e-4c8c-8fa4-470974701afe tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 204 len: 0 microversion: 2.1 time: 0.118304 Sep 28 08:45:21.853906 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 347/724] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:45:21 2022] DELETE /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:45:21.864302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:21.865148 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:21.871583 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.872076 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.872508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.873271 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.873718 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.874142 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.916271 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-cd8c3576-37fc-4dc8-bd4d-148e14bf72f0 req-d0c4b786-84b6-474f-96d6-06a6efd40211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01e6e1b-84cf-44b2-85ec-dba5603c76ae", "tag": "4d6b9373-73e3-4bd1-aca0-9a1bba180a33"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:21.928818 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-cd8c3576-37fc-4dc8-bd4d-148e14bf72f0 req-d0c4b786-84b6-474f-96d6-06a6efd40211 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:21.929893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-cd8c3576-37fc-4dc8-bd4d-148e14bf72f0 req-d0c4b786-84b6-474f-96d6-06a6efd40211 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:21.930595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-cd8c3576-37fc-4dc8-bd4d-148e14bf72f0 req-d0c4b786-84b6-474f-96d6-06a6efd40211 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:21.945442 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-cd8c3576-37fc-4dc8-bd4d-148e14bf72f0 req-d0c4b786-84b6-474f-96d6-06a6efd40211 service nova] Creating event network-changed:4d6b9373-73e3-4bd1-aca0-9a1bba180a33 for instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae on hv-cinder-84456 Sep 28 08:45:21.951473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-cd8c3576-37fc-4dc8-bd4d-148e14bf72f0 req-d0c4b786-84b6-474f-96d6-06a6efd40211 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040959 Sep 28 08:45:21.952806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 348/725] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:22.016129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:22.023647 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a001c9e7-3b27-4cd9-90ac-f94e5c26b1f2 tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.163777 Sep 28 08:45:22.024196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 378/726] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:21 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:22.492146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:22.492830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:22.499344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:22.499824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:22.500250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:22.500930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:22.501404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:22.501827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:22.631755 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:22.640404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:22.641873 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:22.642968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ed3f8533-aaa4-40c5-8f3f-b198f3bbc7ef tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.155538 Sep 28 08:45:22.643519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 349/727] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:22 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:23.047730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:23.048334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:23.054676 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:23.055155 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:23.055581 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:23.056255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:23.056701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:23.057788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:23.186473 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:23.194117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3d1c0204-7c6f-45cf-81d1-d834cf11064f tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.150482 Sep 28 08:45:23.194677 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 379/728] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:23 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:23.668193 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:23.668738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:23.675239 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:23.675712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:23.676142 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:23.676817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:23.677287 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:23.677705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:23.809442 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:23.817646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:23.819079 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:23.820195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-920e2b6c-9d18-453f-8e7d-31aaba7ce976 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.156487 Sep 28 08:45:23.820973 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 350/729] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:23 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:24.217419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:24.218042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:24.224390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:24.224869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:24.225337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:24.226020 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:24.226465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:24.226880 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:24.357885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:24.370334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bac70186-d7aa-422e-9025-644308f6554d tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1521 microversion: 2.1 time: 0.156867 Sep 28 08:45:24.370963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 380/730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:24 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:24.845186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:24.847094 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:24.854062 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:24.854806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:24.855252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:24.855955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:24.856570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:24.857194 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:24.944724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-5d58e687-e9a4-40b6-bf31-dee9ca80b670 req-5f0c415e-7f55-4b08-b6b0-5b7c668cfd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53562009-e64b-47ed-8dd7-890647fe3e44", "name": "network-vif-deleted", "tag": "f6ac07f3-2675-41dc-968c-7b86388bb047"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:24.955253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-5d58e687-e9a4-40b6-bf31-dee9ca80b670 req-5f0c415e-7f55-4b08-b6b0-5b7c668cfd3c service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:24.955979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-5d58e687-e9a4-40b6-bf31-dee9ca80b670 req-5f0c415e-7f55-4b08-b6b0-5b7c668cfd3c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:24.956482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-5d58e687-e9a4-40b6-bf31-dee9ca80b670 req-5f0c415e-7f55-4b08-b6b0-5b7c668cfd3c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:24.971898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-5d58e687-e9a4-40b6-bf31-dee9ca80b670 req-5f0c415e-7f55-4b08-b6b0-5b7c668cfd3c service nova] Creating event network-vif-deleted:f6ac07f3-2675-41dc-968c-7b86388bb047 for instance 53562009-e64b-47ed-8dd7-890647fe3e44 on hv-cinder-84456 Sep 28 08:45:24.976902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-5d58e687-e9a4-40b6-bf31-dee9ca80b670 req-5f0c415e-7f55-4b08-b6b0-5b7c668cfd3c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035784 Sep 28 08:45:24.978470 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 381/731] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:25.018760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:25.028500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:25.030262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:25.031402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-084ff1fd-a0fc-4f01-93fd-aa5bbf0caba7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.190300 Sep 28 08:45:25.031941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 351/732] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:24 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:25.394959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:25.395572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:25.402352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:25.402838 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:25.403278 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:25.403970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:25.404427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:25.404855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:25.467641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:25.475330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dee2b941-f01e-4d5b-a596-fb1ffc5a071e tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1479 microversion: 2.1 time: 0.085186 Sep 28 08:45:25.475897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 382/733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:25 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:26.056702 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:26.057475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:26.060839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:26.064796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:26.065328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:26.065796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:26.066491 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:26.066949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:26.067374 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:26.199940 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:26.207939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:26.209419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:26.210530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-77c9c8ff-9f45-4283-9608-cd90904e18f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.157781 Sep 28 08:45:26.211084 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 352/734] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:26 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:26.498325 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:26.498932 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:26.505428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:26.505913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:26.506351 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:26.507045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:26.507501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:26.507927 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:26.568943 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:26.576710 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c7aea688-13e4-406e-9a53-12ecf59f7aef tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1479 microversion: 2.1 time: 0.082283 Sep 28 08:45:26.577303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 383/735] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:26 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1479 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:27.235364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:27.236108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:27.242440 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:27.242924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:27.243361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:27.244055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:27.245014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:27.245470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:27.374112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:27.382040 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:27.383556 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:27.384670 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-53cc8880-0436-412b-a5f6-7663cffaf55a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.153211 Sep 28 08:45:27.385304 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 353/736] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:27 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:27.600704 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:27.601350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:27.608281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:27.608766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:27.609244 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:27.609942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:27.610396 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:27.610820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:27.675594 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d712e201f2c47a8a48b6e24559e0d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42699952850d49fdafb670aeb5f613ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:27.684114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6e43943d-e086-4458-b13d-63e47712d55c tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 200 len: 1479 microversion: 2.1 time: 0.087271 Sep 28 08:45:27.684675 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 384/737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:27 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 1479 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:28.409344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:28.409961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:28.417701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:28.418196 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:28.418632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:28.419340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:28.419835 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:28.420534 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:28.424646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:28.552337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:28.561509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:28.563033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:28.564152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-92e897eb-7b72-415b-aff7-38e9b4effcb9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.158803 Sep 28 08:45:28.564706 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 354/738] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:28 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:28.706797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:28.707389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] [instance: 53562009-e64b-47ed-8dd7-890647fe3e44] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:28.714437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:28.714919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:28.715354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:28.716048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:28.716503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:28.716924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:28.735421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] HTTP exception thrown: Instance 53562009-e64b-47ed-8dd7-890647fe3e44 could not be found. Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Request method failure captured: Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 HTTP/1.1 Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf1E8anRpf9Y3Phr433YXemtTmRCIPS0gN4YK9hNtuYt44jxbho8BovV3qNnp3m2RFR2ibzPeasINTLiedCt52ce5SAyNjwFYwpWLPhGBJqSFGpHL1zJfQbGgFFriB_YBnLHbC80pjy61XCtUIULs1ZgDjNtyRekNy3hLZpD_ANccU Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:45:28.737169 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/42699952850d49fdafb670aeb5f613ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_42699952850d49fdafb670aeb5f613ed", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 42699952850d49fdafb670aeb5f613ed Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-108095074 Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7d712e201f2c47a8a48b6e24559e0d60 Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-108095074-project Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 53562009-e64b-47ed-8dd7-890647fe3e44 could not be found. Sep 28 08:45:28.738657 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '53562009-e64b-47ed-8dd7-890647fe3e44'} Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53562009-e64b-47ed-8dd7-890647fe3e44 could not be found. Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:45:28.739486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53562009-e64b-47ed-8dd7-890647fe3e44 could not be found. Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53562009-e64b-47ed-8dd7-890647fe3e44 could not be found. Sep 28 08:45:28.741000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:45:28.742344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] Returning 404 to user: Instance 53562009-e64b-47ed-8dd7-890647fe3e44 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:45:28.742344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8e031633-03ff-4bca-a054-ac01b86889db tempest-ServerRescueNegativeTestJSON-108095074 tempest-ServerRescueNegativeTestJSON-108095074-project] 10.222.0.52 "GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44" status: 404 len: 111 microversion: 2.1 time: 0.035775 Sep 28 08:45:28.742344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 385/739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:28 2022] GET /compute/v2.1/servers/53562009-e64b-47ed-8dd7-890647fe3e44 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:45:29.589539 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:29.590891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:29.592598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:29.593481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:29.599984 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:29.600473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:29.600908 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:29.601657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:29.602104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:29.602521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:29.745958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:29.754767 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:29.756219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:29.757379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-cbcc8c16-81b4-4655-8093-460f58582fc7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.171794 Sep 28 08:45:29.757941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 355/740] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:29 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:30.782810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:30.783324 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:30.786298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:30.790624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:30.791334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:30.792255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:30.792954 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:30.793431 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:30.793849 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:30.936312 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:30.945781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:30.947670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:30.948781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7caa6b4a-6daf-41a4-aafe-d95c5f6d0c0e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.169897 Sep 28 08:45:30.965868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 386/741] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:30 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:31.603613 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-1708c2f6-5e66-42f9-9f79-88062c63cd2b req-d9015d7b-ece2-4e05-bc4a-b5fbd0b4aa63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01e6e1b-84cf-44b2-85ec-dba5603c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "4d6b9373-73e3-4bd1-aca0-9a1bba180a33"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:31.617104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-1708c2f6-5e66-42f9-9f79-88062c63cd2b req-d9015d7b-ece2-4e05-bc4a-b5fbd0b4aa63 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:31.617716 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-1708c2f6-5e66-42f9-9f79-88062c63cd2b req-d9015d7b-ece2-4e05-bc4a-b5fbd0b4aa63 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:31.618342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-1708c2f6-5e66-42f9-9f79-88062c63cd2b req-d9015d7b-ece2-4e05-bc4a-b5fbd0b4aa63 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:31.632059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-1708c2f6-5e66-42f9-9f79-88062c63cd2b req-d9015d7b-ece2-4e05-bc4a-b5fbd0b4aa63 service nova] Creating event network-vif-plugged:4d6b9373-73e3-4bd1-aca0-9a1bba180a33 for instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae on hv-cinder-84456 Sep 28 08:45:31.638701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-1708c2f6-5e66-42f9-9f79-88062c63cd2b req-d9015d7b-ece2-4e05-bc4a-b5fbd0b4aa63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 Sep 28 08:45:31.640080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 356/742] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:31.974770 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:31.975381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:31.987847 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:31.988447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:31.988898 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:31.989921 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:31.990456 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:31.990985 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:32.160140 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:32.169857 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:32.171821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:32.173122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d0379547-9b98-4d6f-b1fd-17b903e19298 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.202200 Sep 28 08:45:32.173766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 387/743] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:31 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:45:33.199689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:33.200196 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:33.208745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:33.209276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:33.209716 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:33.210420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:33.210874 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:33.211300 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:33.346444 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:33.355596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:33.357043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:33.358194 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fb736060-59e7-43b6-b6ad-e03d61e69d58 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1406 microversion: 2.20 time: 0.163735 Sep 28 08:45:33.358751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 357/744] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:33 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:45:34.383955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:34.384640 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:34.387534 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:34.392970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:34.393495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:34.393918 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:34.394619 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:34.395073 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:34.395499 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:34.813599 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:34.821963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:34.823990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:34.825221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4ae26462-e9e7-4fba-81ab-9be6d8db08ca tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1598 microversion: 2.20 time: 0.445135 Sep 28 08:45:34.825786 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 388/745] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:45:34 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1598 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:45:34.851712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:34.852625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:34.860823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:34.861866 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:34.862564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:34.863550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:34.864009 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:34.864432 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:34.966719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-685a9950-28c4-4efe-a11a-844cbd2b443d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.119413 Sep 28 08:45:34.967546 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 358/746] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Sep 28 08:45:34 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 28 08:45:36.039993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-de55cd8f-adfb-4102-935b-af39b182e222 req-11764876-6583-4a35-96cd-044989e18fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01e6e1b-84cf-44b2-85ec-dba5603c76ae", "tag": "4d6b9373-73e3-4bd1-aca0-9a1bba180a33"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:36.053315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-de55cd8f-adfb-4102-935b-af39b182e222 req-11764876-6583-4a35-96cd-044989e18fda service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:36.054235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-de55cd8f-adfb-4102-935b-af39b182e222 req-11764876-6583-4a35-96cd-044989e18fda service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:36.054972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-de55cd8f-adfb-4102-935b-af39b182e222 req-11764876-6583-4a35-96cd-044989e18fda service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:36.070625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-de55cd8f-adfb-4102-935b-af39b182e222 req-11764876-6583-4a35-96cd-044989e18fda service nova] Creating event network-changed:4d6b9373-73e3-4bd1-aca0-9a1bba180a33 for instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae on hv-cinder-84456 Sep 28 08:45:36.077485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-de55cd8f-adfb-4102-935b-af39b182e222 req-11764876-6583-4a35-96cd-044989e18fda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041036 Sep 28 08:45:36.079411 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 389/747] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:46.977476 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=12 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:46.978227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=22 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:46.982847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:46.985014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:46.992334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:46.993042 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:46.993426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:46.994187 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:46.994821 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:46.995299 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:47.029039 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e3515158-530e-4b73-89fc-7ad38efcb055 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052438 Sep 28 08:45:47.029683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 359/748] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:45:46 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:45:47.095665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:47.096403 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=64 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:45:47.101184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:47.101781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:47.109445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:47.109967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:47.110582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:47.111282 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:47.111771 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:47.112298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:47.137866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:45:47.226882 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5e5d2750-40e4-487d-881a-df96cf1152d1 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 204 len: 0 microversion: 2.1 time: 0.131975 Sep 28 08:45:47.228045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 390/749] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:45:47 2022] DELETE /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:45:47.237679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:47.238403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:47.247364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:47.247857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:47.248304 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:47.249007 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:47.249488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:47.249912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:47.394316 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:47.402036 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-de3a5e8f-da98-45ad-a6f6-18e1763900d0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1673 microversion: 2.1 time: 0.169370 Sep 28 08:45:47.402603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 360/750] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:47 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:48.430061 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:48.431562 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:48.439764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:48.440473 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:48.440920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:48.441789 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:48.442248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:48.442669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:48.584395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:48.592981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-560736cc-e499-45e6-9704-3803058fa93d tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1673 microversion: 2.1 time: 0.170686 Sep 28 08:45:48.593812 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 391/751] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:48 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:49.619377 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:49.619978 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:49.626776 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:49.627267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:49.627697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:49.628391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:49.629008 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:49.629455 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:49.731748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:49.752036 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2403491f-0d01-435d-be14-abc31db91188 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 200 len: 1605 microversion: 2.1 time: 0.136417 Sep 28 08:45:49.752631 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 361/752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:49 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 1605 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:49.895390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-25a92073-9dd7-4453-b512-6d3a4446c179 req-bf12b757-23d3-404e-9b7f-ed3a9528ed8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdf04325-2791-450a-8f0c-7ab39f891ec4", "name": "network-vif-deleted", "tag": "c6a4b931-a59a-4621-8e16-7c3e343a1e8a"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:49.909726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-25a92073-9dd7-4453-b512-6d3a4446c179 req-bf12b757-23d3-404e-9b7f-ed3a9528ed8d service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:49.910256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-25a92073-9dd7-4453-b512-6d3a4446c179 req-bf12b757-23d3-404e-9b7f-ed3a9528ed8d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:49.910668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-25a92073-9dd7-4453-b512-6d3a4446c179 req-bf12b757-23d3-404e-9b7f-ed3a9528ed8d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:49.944879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-25a92073-9dd7-4453-b512-6d3a4446c179 req-bf12b757-23d3-404e-9b7f-ed3a9528ed8d service nova] Creating event network-vif-deleted:c6a4b931-a59a-4621-8e16-7c3e343a1e8a for instance bdf04325-2791-450a-8f0c-7ab39f891ec4 on hv-cinder-84456 Sep 28 08:45:49.952477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-25a92073-9dd7-4453-b512-6d3a4446c179 req-bf12b757-23d3-404e-9b7f-ed3a9528ed8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060729 Sep 28 08:45:49.953866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 392/753] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:45:50.785598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:50.786875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:50.793854 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:50.794580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:50.795198 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:50.796147 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:50.796592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:50.797189 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:50.811606 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] HTTP exception thrown: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Request method failure captured: Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 HTTP/1.1 Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf1VSsxEnsfrthzWppIwFlCFtRqli5d887B_qj1Ilcx_XpV2IEWfxzCqd7Dluw-18pFkmes-Eyal00q6fqxz8TazrRiRn7jqibNZ4bjq109l0yYLyMq_RHUCrb6THULUDv5QOvw7AvIBOewPzhjRJHWjukmN2RGjct_uW4iLHE8XE8 Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: d3e65d28e5664025978902943452f338 Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:45:50.813439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3e65d28e5664025978902943452f338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3e65d28e5664025978902943452f338", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: d3e65d28e5664025978902943452f338 Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: fe0fcdeafae645a582afcee3dde79ebc Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:45:50.815231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'bdf04325-2791-450a-8f0c-7ab39f891ec4'} Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:45:50.816218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:45:50.817781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:45:50.819557 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Returning 404 to user: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:45:50.819557 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-82ad6e20-17d0-4a2f-a8de-bbe2e62f954b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 404 len: 111 microversion: 2.1 time: 0.033447 Sep 28 08:45:50.819557 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 362/754] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:50 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:45:50.825297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-17dd6f1d-711a-4377-8725-8fd5de7216e3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '.version_select at 0x7f984facb0d0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:50.847001 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-17dd6f1d-711a-4377-8725-8fd5de7216e3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445120533" status: 202 len: 0 microversion: 2.1 time: 0.026731 Sep 28 08:45:50.847710 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 393/755] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Sep 28 08:45:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445120533 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:45:51.645216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ee0f3d9d-a1e4-413f-acde-2401c720fcd0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'create', calling method: .version_select at 0x7f984fb2c8b0>, body: {"keypair": {"name": "tempest-keypair-1917652473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaYXYxGulrDFJqUHnc+pPJt0AhdjUNes29BBq99f1MO4nAfPNVOiUw+mnY8tCmT6SqDM8Y/VLAAi/j6I1KS4KIjGP2X7gcaiQ++R2DSb6lirS9n7r6Ru2AVDHLIpSZI5g=="}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:51.660967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-ee0f3d9d-a1e4-413f-acde-2401c720fcd0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for project d3e65d28e5664025978902943452f338. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:45:51.665181 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-ee0f3d9d-a1e4-413f-acde-2401c720fcd0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for user fe0fcdeafae645a582afcee3dde79ebc and project d3e65d28e5664025978902943452f338. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:45:51.690014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ee0f3d9d-a1e4-413f-acde-2401c720fcd0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049021 Sep 28 08:45:51.690779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 363/756] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:45:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:53.024373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2084655775", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff034301-a1c4-4028-a91c-012c3b139427"}], "security_groups": [{"name": "tempest-securitygroup--1787117062"}], "key_name": "tempest-keypair-1917652473", "user_data": "}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:53.133866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] validate_networks() for [('ff034301-a1c4-4028-a91c-012c3b139427', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:45:53.511459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:45:53.511955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:45:53.513274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:45:53.518956 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:45:53.519549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:45:53.538138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:53.538521 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:53.538960 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:53.539689 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:53.540148 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:53.540573 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:53.558559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for project d3e65d28e5664025978902943452f338. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:45:53.563177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Getting quotas for user fe0fcdeafae645a582afcee3dde79ebc and project d3e65d28e5664025978902943452f338. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:45:53.576234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:45:53.578769 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:45:53.626505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-260b6a04-6b98-4ae4-b71b-e4569f659683 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.607214 Sep 28 08:45:53.627177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 394/757] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:45:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:45:53.638638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7e873ccb-afd4-4777-b0ca-023fcd669667 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:53.639240 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7e873ccb-afd4-4777-b0ca-023fcd669667 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:53.697145 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7e873ccb-afd4-4777-b0ca-023fcd669667 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:53.704695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7e873ccb-afd4-4777-b0ca-023fcd669667 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1238 microversion: 2.1 time: 0.070319 Sep 28 08:45:53.705321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 364/758] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:53 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:54.727623 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:54.728234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:54.734410 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:54.734895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:54.735334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:54.736025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:54.736485 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:54.736909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:54.802589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:54.810506 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-41198297-f6be-4e86-a700-1489c7ccab18 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1290 microversion: 2.1 time: 0.087204 Sep 28 08:45:54.811072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 395/759] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:54 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:55.833892 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:55.834512 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:55.842336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:55.842998 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:55.843556 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:55.845478 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:55.846524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:55.847748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:56.017053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:56.025237 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ed22e488-dcca-4070-a8a6-44172a264168 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.195426 Sep 28 08:45:56.025829 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 365/760] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:55 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:56.706866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-66935e38-07da-45a2-a1e7-695b8850fa32 req-899904a1-6739-4993-b013-d3b12b85efbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49faa65a-11f3-4287-b392-09d1966a700e", "tag": "224164fb-d3cb-4731-9747-97bba286b111"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:45:56.719724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-66935e38-07da-45a2-a1e7-695b8850fa32 req-899904a1-6739-4993-b013-d3b12b85efbb service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:56.720490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-66935e38-07da-45a2-a1e7-695b8850fa32 req-899904a1-6739-4993-b013-d3b12b85efbb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:56.721417 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-66935e38-07da-45a2-a1e7-695b8850fa32 req-899904a1-6739-4993-b013-d3b12b85efbb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:56.734709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-66935e38-07da-45a2-a1e7-695b8850fa32 req-899904a1-6739-4993-b013-d3b12b85efbb service nova] Creating event network-changed:224164fb-d3cb-4731-9747-97bba286b111 for instance 49faa65a-11f3-4287-b392-09d1966a700e on hv-cinder-84456 Sep 28 08:45:56.739892 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-66935e38-07da-45a2-a1e7-695b8850fa32 req-899904a1-6739-4993-b013-d3b12b85efbb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037339 Sep 28 08:45:56.740603 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 396/761] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:45:57.049591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:57.050206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:57.057521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:57.058016 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:57.058455 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:57.059663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:57.060119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:57.060588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:57.214788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:57.223918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-109e1bdf-7969-4048-b2ca-00b320818976 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.179344 Sep 28 08:45:57.237296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 366/762] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:57 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:58.249067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:58.249869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:58.256300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:58.256726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:58.257375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:58.258397 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:58.258868 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:58.259301 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:58.404218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:58.413123 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7120097c-95ee-4a3b-af66-c9bbc079e853 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.169606 Sep 28 08:45:58.413701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 397/763] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:58 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:45:59.437573 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:45:59.438221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:45:59.444579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:59.445367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:59.445812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:59.446871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:45:59.447386 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:45:59.447742 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:45:59.579249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:45:59.586987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-cd9918ae-563c-4b6a-8fb5-62a96ef8fb86 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.153962 Sep 28 08:45:59.587544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 367/764] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:45:59 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:00.610858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:00.611690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:00.620110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:00.620703 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:00.621235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:00.622009 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:00.622496 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:00.622924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:00.771152 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:00.779300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5fa309a0-b03c-450b-b66b-f96266bd3f17 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.172304 Sep 28 08:46:00.780099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 398/765] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:00 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:01.802781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:01.803384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:01.810026 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:01.810510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:01.810941 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:01.811630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:01.812077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:01.812498 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:01.960154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:01.968516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ece676ef-c468-4c69-9301-6a56fa39fb05 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.169495 Sep 28 08:46:01.969106 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 368/766] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:01 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:02.991542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:02.992758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:02.999749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:03.000231 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:03.000665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:03.001401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:03.001856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:03.002283 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:03.141986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:03.150544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5fed1080-c6ed-45af-a843-e76dd4f79157 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.163332 Sep 28 08:46:03.151113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 399/767] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:02 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:03.863907 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-6e219788-ea99-407a-a356-a09ba427c045 req-0cbe64e8-fd5b-4c67-9f1b-7c2209aba64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49faa65a-11f3-4287-b392-09d1966a700e", "name": "network-vif-plugged", "status": "completed", "tag": "224164fb-d3cb-4731-9747-97bba286b111"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:03.886171 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:03.891481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-6e219788-ea99-407a-a356-a09ba427c045 req-0cbe64e8-fd5b-4c67-9f1b-7c2209aba64c service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:03.893990 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-6e219788-ea99-407a-a356-a09ba427c045 req-0cbe64e8-fd5b-4c67-9f1b-7c2209aba64c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:03.895396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-6e219788-ea99-407a-a356-a09ba427c045 req-0cbe64e8-fd5b-4c67-9f1b-7c2209aba64c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:03.917190 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-6e219788-ea99-407a-a356-a09ba427c045 req-0cbe64e8-fd5b-4c67-9f1b-7c2209aba64c service nova] Creating event network-vif-plugged:224164fb-d3cb-4731-9747-97bba286b111 for instance 49faa65a-11f3-4287-b392-09d1966a700e on hv-cinder-84456 Sep 28 08:46:03.932279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-6e219788-ea99-407a-a356-a09ba427c045 req-0cbe64e8-fd5b-4c67-9f1b-7c2209aba64c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076685 Sep 28 08:46:03.933211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 369/768] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:04.174072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:04.174683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:04.176682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:04.177371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:04.183664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:04.184152 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:04.184642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:04.185380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:04.185838 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:04.186262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:04.326793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:04.334601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0dd3dd5b-7f2b-4a6c-a552-2d2cba4d9cdb tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.164665 Sep 28 08:46:04.335173 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 400/769] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:04 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:05.030593 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1016438975", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "networks": [{"uuid": "e0943dc5-f513-4bf7-90d4-1fd4b5eef58e"}]}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:05.083113 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] validate_networks() for [('e0943dc5-f513-4bf7-90d4-1fd4b5eef58e', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:46:05.357714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:05.360441 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:05.365253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:05.365754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:05.366193 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:05.366899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:05.367355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:05.367779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:05.491074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:46:05.491503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:46:05.491967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:46:05.492368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:46:05.492791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:46:05.501759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:05.502233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:05.502661 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:05.503377 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:05.503824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:05.504241 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:05.520905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:05.521581 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Getting quotas for project bfe1975eab4d4dad9aab52c90493bf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:46:05.525888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Getting quotas for user 5cae6744964d4cabaf0ef00a23057c85 and project bfe1975eab4d4dad9aab52c90493bf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:46:05.529529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f7bc252d-01e2-46f5-a780-b5fdf5c55767 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1364 microversion: 2.1 time: 0.175534 Sep 28 08:46:05.530600 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 401/770] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:05 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:46:05.546305 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:46:05.549136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:46:05.599692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6ec2e2c6-2a56-404b-835f-bb9329fabd15 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573950 Sep 28 08:46:05.600340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 370/771] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:46:05.612057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-93f63ad6-d71a-4b53-ab4c-51d3a1d689b3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:05.612825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-93f63ad6-d71a-4b53-ab4c-51d3a1d689b3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:05.670558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-93f63ad6-d71a-4b53-ab4c-51d3a1d689b3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:05.678398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-93f63ad6-d71a-4b53-ab4c-51d3a1d689b3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1219 microversion: 2.1 time: 0.070195 Sep 28 08:46:05.678971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 402/772] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:05 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:06.553047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:06.553737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:06.559954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:06.560439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:06.560874 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:06.561608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:06.562066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:06.562490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:06.694002 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:06.702149 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:06.702660 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e49cc172-b99b-46f1-8436-a8bb7a270df6 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1549 microversion: 2.1 time: 0.153755 Sep 28 08:46:06.702787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:06.702994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 371/773] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:06 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:06.710074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:06.710559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:06.710997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:06.711696 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:06.712151 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:06.712576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:06.724436 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:06.724928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:06.730930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:06.731460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:06.731895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:06.732592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:06.733051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:06.733515 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:06.775758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:06.784945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0c0c7981-2c57-491c-a8c9-aca37ad2451d tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1271 microversion: 2.1 time: 0.087184 Sep 28 08:46:06.785547 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 403/774] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:06 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:46:06.820583 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bfb33fb4-e5ec-4fe0-8572-8ba73ec1d97a tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099901 Sep 28 08:46:06.821204 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 372/775] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:46:06 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:46:07.807973 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:07.810524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:07.819444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:07.820491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:07.821015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:07.821899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:07.822360 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:07.823013 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:08.164373 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-84a0fb0f-892d-46bc-9edc-350143caeeab req-3fddd6f0-a63d-4189-9338-7abcf007b3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49faa65a-11f3-4287-b392-09d1966a700e", "tag": "224164fb-d3cb-4731-9747-97bba286b111"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:08.170182 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:08.180591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6523a42e-2d84-4990-9559-b8e2b0f7335e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.376322 Sep 28 08:46:08.181520 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-84a0fb0f-892d-46bc-9edc-350143caeeab req-3fddd6f0-a63d-4189-9338-7abcf007b3d7 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:08.182011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-84a0fb0f-892d-46bc-9edc-350143caeeab req-3fddd6f0-a63d-4189-9338-7abcf007b3d7 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:08.182334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 404/776] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:07 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:08.182482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-84a0fb0f-892d-46bc-9edc-350143caeeab req-3fddd6f0-a63d-4189-9338-7abcf007b3d7 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:08.194356 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-84a0fb0f-892d-46bc-9edc-350143caeeab req-3fddd6f0-a63d-4189-9338-7abcf007b3d7 service nova] Creating event network-changed:224164fb-d3cb-4731-9747-97bba286b111 for instance 49faa65a-11f3-4287-b392-09d1966a700e on hv-cinder-84456 Sep 28 08:46:08.199731 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-84a0fb0f-892d-46bc-9edc-350143caeeab req-3fddd6f0-a63d-4189-9338-7abcf007b3d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041758 Sep 28 08:46:08.200503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 373/777] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:08.367608 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-b918db79-d9c5-4a42-8e54-423f84f06a5d req-0bfc7ab8-4c72-4167-8c98-ee243fc2e148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb92ccd6-c465-416c-a715-84efa8668ad2", "tag": "7401d624-9a08-4c27-a133-b9997af58cd5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:08.382288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b918db79-d9c5-4a42-8e54-423f84f06a5d req-0bfc7ab8-4c72-4167-8c98-ee243fc2e148 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:08.383245 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b918db79-d9c5-4a42-8e54-423f84f06a5d req-0bfc7ab8-4c72-4167-8c98-ee243fc2e148 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:08.383871 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-b918db79-d9c5-4a42-8e54-423f84f06a5d req-0bfc7ab8-4c72-4167-8c98-ee243fc2e148 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:08.398389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-b918db79-d9c5-4a42-8e54-423f84f06a5d req-0bfc7ab8-4c72-4167-8c98-ee243fc2e148 service nova] Creating event network-changed:7401d624-9a08-4c27-a133-b9997af58cd5 for instance bb92ccd6-c465-416c-a715-84efa8668ad2 on hv-cinder-84456 Sep 28 08:46:08.407314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-b918db79-d9c5-4a42-8e54-423f84f06a5d req-0bfc7ab8-4c72-4167-8c98-ee243fc2e148 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053938 Sep 28 08:46:08.408450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 405/778] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:09.207326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:09.208137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:09.215577 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:09.216250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:09.216786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:09.217642 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:09.218207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:09.218868 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:09.363700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:09.374653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3569d4eb-4a6d-49dd-8471-c07e22916614 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.172065 Sep 28 08:46:09.390072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 374/779] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:09 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:10.398748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:10.399448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:10.406559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:10.407047 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:10.407493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:10.408180 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:10.408639 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:10.409062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:10.540973 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:10.549497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-78df45fa-cc7e-4831-9aad-adcce5519fb3 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.154920 Sep 28 08:46:10.550114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 406/780] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:10 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:11.572047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:11.572672 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:11.579573 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:11.580330 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:11.580764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:11.581487 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:11.581938 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:11.582360 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:11.709870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:11.717987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-937ba39b-3aad-4acf-8aeb-f712df7615f1 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.149829 Sep 28 08:46:11.718563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 375/781] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:11 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:12.740968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:12.741776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:12.748366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:12.748856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:12.749324 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:12.750233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:12.750699 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:12.751132 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:12.883357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:12.891363 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-576f6c91-62e9-48cf-a784-cbc5201f24a4 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.154372 Sep 28 08:46:12.892544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 407/782] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:12 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:13.916243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:13.916878 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:13.923586 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:13.924063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:13.924517 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:13.925233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:13.936236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:13.936759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:14.073259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:14.080991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-07e13124-a26f-4852-a9e0-523c6969dbde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.168974 Sep 28 08:46:14.081524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 376/783] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:13 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:15.103726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:15.104257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:15.110373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:15.110861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:15.111301 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:15.112022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:15.112476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:15.112901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:15.241788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:15.249895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5273e10f-b665-4921-92dd-f538c1cdd627 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.150278 Sep 28 08:46:15.250446 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 408/784] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:15 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:15.752352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-db4877b8-fc0c-4dfe-ae0a-a917e8b42f75 req-c81ac8fc-d26c-4ebb-81a8-7be0aca97da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb92ccd6-c465-416c-a715-84efa8668ad2", "name": "network-vif-plugged", "status": "completed", "tag": "7401d624-9a08-4c27-a133-b9997af58cd5"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:15.757992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:15.758705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:15.768008 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-db4877b8-fc0c-4dfe-ae0a-a917e8b42f75 req-c81ac8fc-d26c-4ebb-81a8-7be0aca97da4 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:15.768757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-db4877b8-fc0c-4dfe-ae0a-a917e8b42f75 req-c81ac8fc-d26c-4ebb-81a8-7be0aca97da4 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:15.769220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-db4877b8-fc0c-4dfe-ae0a-a917e8b42f75 req-c81ac8fc-d26c-4ebb-81a8-7be0aca97da4 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:15.781278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-db4877b8-fc0c-4dfe-ae0a-a917e8b42f75 req-c81ac8fc-d26c-4ebb-81a8-7be0aca97da4 service nova] Creating event network-vif-plugged:7401d624-9a08-4c27-a133-b9997af58cd5 for instance bb92ccd6-c465-416c-a715-84efa8668ad2 on hv-cinder-84456 Sep 28 08:46:15.786651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-db4877b8-fc0c-4dfe-ae0a-a917e8b42f75 req-c81ac8fc-d26c-4ebb-81a8-7be0aca97da4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037593 Sep 28 08:46:15.787417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 377/785] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:16.273218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:16.273833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:16.275910 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:16.282580 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:16.283127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:16.283570 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:16.284287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:16.284820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:16.285517 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:16.304171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:16.421970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:16.429490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-42bbff95-f6c0-4ae1-a215-cddf90bb6f3f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.160359 Sep 28 08:46:16.430057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 409/786] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:16 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:17.452825 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:17.453455 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:17.455818 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:17.461334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:17.461810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:17.462238 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:17.462921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:17.463362 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:17.463786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:17.467767 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=81 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:17.600698 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:17.608279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1bebaf47-37b2-472c-9bbf-71e138add95b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1319 microversion: 2.1 time: 0.159800 Sep 28 08:46:17.608835 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 378/787] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:17 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:18.631332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:18.631965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:18.634361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:18.639757 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:18.640250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:18.640689 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:18.641413 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:18.641881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:18.642308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:18.787993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:18.796432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-24b5d4bf-1d50-4493-897e-e7480031ddb5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1509 microversion: 2.1 time: 0.168746 Sep 28 08:46:18.796986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 410/788] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:18 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:19.108031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:19.108542 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:19.115509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:19.115997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:19.116433 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:19.117249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:19.117710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:19.118139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:19.142693 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8a810f44-70c4-4c20-a010-a6083e27eeb3 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/ips" status: 200 len: 149 microversion: 2.1 time: 0.038906 Sep 28 08:46:19.143268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 379/789] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:46:19 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:20.558100 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7ec9e48-2e89-4460-8d3b-f729cac81f5c"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:20.560453 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:20.567299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:20.567785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:20.568223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:20.568910 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:20.569405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:20.569831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:20.869622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0067f525-8adc-46af-aafa-16b06906b8c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315126 Sep 28 08:46:20.870237 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 411/790] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:46:20 2022] POST /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:28.435798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7ec9e48-2e89-4460-8d3b-f729cac81f5c"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:28.438194 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:28.444884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:28.445408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:28.446267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:28.446555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:28.447013 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:28.447441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:28.527076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Invalid volume: volume d7ec9e48-2e89-4460-8d3b-f729cac81f5c is already attached to instances: e6ab421e-2f19-43f0-8732-27ded4ece5d7 Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: POST /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments HTTP/1.1 Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 74 Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:46:28.528813 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {"volumeAttachment": {"volumeId": "d7ec9e48-2e89-4460-8d3b-f729cac81f5c"}} Sep 28 08:46:28.531031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Invalid volume: volume d7ec9e48-2e89-4460-8d3b-f729cac81f5c is already attached to instances: e6ab421e-2f19-43f0-8732-27ded4ece5d7 Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'server_id': 'e6ab421e-2f19-43f0-8732-27ded4ece5d7', 'body': {'volumeAttachment': {'volumeId': 'd7ec9e48-2e89-4460-8d3b-f729cac81f5c'}}} Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d7ec9e48-2e89-4460-8d3b-f729cac81f5c is already attached to instances: e6ab421e-2f19-43f0-8732-27ded4ece5d7 Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:28.531886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d7ec9e48-2e89-4460-8d3b-f729cac81f5c is already attached to instances: e6ab421e-2f19-43f0-8732-27ded4ece5d7 Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:28.533261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d7ec9e48-2e89-4460-8d3b-f729cac81f5c is already attached to instances: e6ab421e-2f19-43f0-8732-27ded4ece5d7 Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 400 to user: Invalid volume: volume d7ec9e48-2e89-4460-8d3b-f729cac81f5c is already attached to instances: e6ab421e-2f19-43f0-8732-27ded4ece5d7 {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-625f50c4-746a-4ddc-bbd0-3b9d4af6fe4c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098995 Sep 28 08:46:28.534482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 380/791] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:46:28 2022] POST /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:46:28.603396 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:28.603978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:28.611537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:28.612026 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:28.612466 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:28.613188 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:28.613648 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:28.614074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:28.696344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lazy-loading 'services' on Instance uuid e6ab421e-2f19-43f0-8732-27ded4ece5d7 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:46:28.772266 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9dd9ed1b-a9de-4007-b105-44a3dcf6b749 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments/d7ec9e48-2e89-4460-8d3b-f729cac81f5c" status: 202 len: 0 microversion: 2.1 time: 0.173259 Sep 28 08:46:28.772882 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 412/792] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:46:28 2022] DELETE /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments/d7ec9e48-2e89-4460-8d3b-f729cac81f5c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:46:28.783076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:28.785384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:28.792438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:28.793474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:28.793920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:28.794745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:28.795253 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:28.796558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:28.828167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c0a4c734-db63-45fd-9dc6-94efad8c66ab tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050758 Sep 28 08:46:28.828805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 381/793] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:46:28 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:29.845708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:29.848314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:29.855161 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:29.855638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:29.856067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:29.856751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:29.857226 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:29.857662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:29.889893 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ac9df1fc-d8a7-4cf4-bb1b-d0c156d5da50 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050678 Sep 28 08:46:29.890444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 413/794] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:46:29 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:46:29.955102 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:29.955722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:29.962713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:29.963294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:29.963642 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:29.964344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:29.964797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:29.965257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:29.990291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:46:30.070545 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6300891a-d020-4a50-a8f3-16eef38eefb2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 204 len: 0 microversion: 2.1 time: 0.119632 Sep 28 08:46:30.071129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 382/795] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:46:29 2022] DELETE /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:46:30.079855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:30.080465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:30.086444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:30.086927 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:30.087366 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:30.088055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:30.088509 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:30.088935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:30.215822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:30.223513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-61fccbf5-8cd3-4803-84c3-a2569f08d551 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1678 microversion: 2.1 time: 0.148131 Sep 28 08:46:30.224044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 414/796] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:30 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:31.247828 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:31.248561 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:31.254957 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:31.255435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:31.255868 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:31.256558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:31.257010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:31.257457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:31.385506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:31.393829 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6d6b1039-79a7-480a-9bef-6ebfdeb165da tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1678 microversion: 2.1 time: 0.150377 Sep 28 08:46:31.394391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 383/797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:31 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:32.417628 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:32.418495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:32.425607 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:32.426099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:32.426717 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:32.427432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:32.427891 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:32.428377 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:32.636467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:32.644726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6ed571b5-3949-40d9-bf98-8d5a41d47099 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1678 microversion: 2.1 time: 0.230931 Sep 28 08:46:32.645369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 415/798] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:32 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:32.794291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-6f61398f-72c6-47a6-a7de-024780167c59 req-a540a818-a042-41ff-8389-61578272f77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901f2acc-6433-42cb-a931-82ccde824010", "tag": "ed5b6be5-cf6e-47ab-9c77-e942a22429de"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:32.796693 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:32.799821 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:32.808286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:32.813494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-6f61398f-72c6-47a6-a7de-024780167c59 req-a540a818-a042-41ff-8389-61578272f77b service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:32.814256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:32.814775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:32.815570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:32.816251 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-6f61398f-72c6-47a6-a7de-024780167c59 req-a540a818-a042-41ff-8389-61578272f77b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:32.816836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:32.817355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-6f61398f-72c6-47a6-a7de-024780167c59 req-a540a818-a042-41ff-8389-61578272f77b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:32.820284 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:32.839055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-6f61398f-72c6-47a6-a7de-024780167c59 req-a540a818-a042-41ff-8389-61578272f77b service nova] Creating event network-changed:ed5b6be5-cf6e-47ab-9c77-e942a22429de for instance 901f2acc-6433-42cb-a931-82ccde824010 on hv-cinder-84456 Sep 28 08:46:32.850840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-6f61398f-72c6-47a6-a7de-024780167c59 req-a540a818-a042-41ff-8389-61578272f77b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064476 Sep 28 08:46:32.852083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 416/799] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:32.865673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:46:33.010046 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b5b53a54-8bfc-4df8-a891-d74776832680 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "DELETE /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 204 len: 0 microversion: 2.1 time: 0.225441 Sep 28 08:46:33.010810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 384/800] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:46:32 2022] DELETE /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:46:33.022229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:33.022999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:33.029230 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:33.030320 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:33.031088 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:33.032175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:33.032829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:33.033383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:33.172861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:33.181397 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7a13ed83-ef19-42d9-8623-2229ddd72487 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.165100 Sep 28 08:46:33.197120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 417/801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:33 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:33.283711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-0f9f5f69-4e09-43be-96f8-33ad17c9e417 req-81e1d34e-bf06-4b57-865c-5f30d5a153ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ab421e-2f19-43f0-8732-27ded4ece5d7", "name": "network-vif-deleted", "tag": "0394e60a-0854-4093-8091-63c585ef8d20"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:33.293965 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0f9f5f69-4e09-43be-96f8-33ad17c9e417 req-81e1d34e-bf06-4b57-865c-5f30d5a153ef service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:33.294599 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0f9f5f69-4e09-43be-96f8-33ad17c9e417 req-81e1d34e-bf06-4b57-865c-5f30d5a153ef service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:33.295308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-0f9f5f69-4e09-43be-96f8-33ad17c9e417 req-81e1d34e-bf06-4b57-865c-5f30d5a153ef service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:33.308161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-0f9f5f69-4e09-43be-96f8-33ad17c9e417 req-81e1d34e-bf06-4b57-865c-5f30d5a153ef service nova] Creating event network-vif-deleted:0394e60a-0854-4093-8091-63c585ef8d20 for instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 on hv-cinder-84456 Sep 28 08:46:33.314493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-0f9f5f69-4e09-43be-96f8-33ad17c9e417 req-81e1d34e-bf06-4b57-865c-5f30d5a153ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Sep 28 08:46:33.322101 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 385/802] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:33.667818 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:33.668425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:33.676421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:33.677146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:33.677761 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:33.678506 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:33.679039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:33.679542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:33.750877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:33.759569 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-43dba2c6-8978-42ee-bcef-3a880e8af794 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1612 microversion: 2.1 time: 0.095560 Sep 28 08:46:33.760154 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 418/803] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:33 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1612 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:34.274131 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:34.274833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:34.282151 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:34.282631 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:34.283063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:34.283758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:34.284207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:34.284656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:34.451105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:34.463286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-996050e5-3e9b-4d75-b65f-274b3c1180fc tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.192779 Sep 28 08:46:34.464465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 386/804] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:34 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:34.783321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:34.783934 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:34.790447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:34.790967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:34.791423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:34.792123 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:34.792572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:34.792996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:34.843297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:34.843790 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:34.844227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:34.844679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lazy-loading 'fault' on Instance uuid e6ab421e-2f19-43f0-8732-27ded4ece5d7 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:46:34.888054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:34.896110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-44ab5fdf-2c63-465e-b1fd-32d97f085e4b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 200 len: 1330 microversion: 2.1 time: 0.116577 Sep 28 08:46:34.896884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 419/805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:34 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:35.488421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:35.489031 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:35.495415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:35.495900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:35.496334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:35.497033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:35.497507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:35.497931 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:35.645889 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:35.653897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-107f9ace-22f5-4ac8-911b-5595356d073a tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1565 microversion: 2.1 time: 0.169330 Sep 28 08:46:35.654469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 387/806] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:35 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:35.919948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:35.920592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:35.927292 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:35.927840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:35.928288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:35.928986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:35.929467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:35.929901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:35.944000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 HTTP/1.1 Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:46:35.945766 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:46:35.947229 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'e6ab421e-2f19-43f0-8732-27ded4ece5d7'} Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:46:35.947980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:46:35.949232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:46:35.950346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:46:35.950346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f620068c-e357-4645-9117-0825612b4cf2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 404 len: 111 microversion: 2.1 time: 0.031170 Sep 28 08:46:35.950346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 420/807] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:35 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 08:46:35.956861 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c369cb3a-94d0-4433-afbc-6bf4987184c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '.version_select at 0x7f984fc1e700>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:35.975158 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c369cb3a-94d0-4433-afbc-6bf4987184c6 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74461129" status: 202 len: 0 microversion: 2.1 time: 0.021956 Sep 28 08:46:35.975750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 388/808] 10.222.0.52 () {58 vars in 1215 bytes} [Wed Sep 28 08:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74461129 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:46:36.205838 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-ee9b8054-acc9-497a-be55-0b995c7a101a req-b2ad3a3c-17cf-4e76-8a3e-3be4bf2ec291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901f2acc-6433-42cb-a931-82ccde824010", "name": "network-vif-deleted", "tag": "ed5b6be5-cf6e-47ab-9c77-e942a22429de"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:36.216797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-ee9b8054-acc9-497a-be55-0b995c7a101a req-b2ad3a3c-17cf-4e76-8a3e-3be4bf2ec291 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:36.217650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-ee9b8054-acc9-497a-be55-0b995c7a101a req-b2ad3a3c-17cf-4e76-8a3e-3be4bf2ec291 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:36.218305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-ee9b8054-acc9-497a-be55-0b995c7a101a req-b2ad3a3c-17cf-4e76-8a3e-3be4bf2ec291 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:36.230810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-ee9b8054-acc9-497a-be55-0b995c7a101a req-b2ad3a3c-17cf-4e76-8a3e-3be4bf2ec291 service nova] Creating event network-vif-deleted:ed5b6be5-cf6e-47ab-9c77-e942a22429de for instance 901f2acc-6433-42cb-a931-82ccde824010 on hv-cinder-84456 Sep 28 08:46:36.236634 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-ee9b8054-acc9-497a-be55-0b995c7a101a req-b2ad3a3c-17cf-4e76-8a3e-3be4bf2ec291 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035124 Sep 28 08:46:36.237255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 421/809] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:46:36.672867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-eb45f884-8635-476d-a741-a6789d6d470b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: .version_select at 0x7f984fb2c8b0>, body: {"keypair": {"name": "tempest-keypair-1076186214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxB/T0OYehYNeVSeDnl8UX2BLFzMhNT4zDOXCzX9erftu36SMaA9/iaJaDM/6nSCsPYNtTA9h1f8y9Ur3R/1znh0V92aCz7JTNozfPyJZ+GjMztZoN9X+3HhtPKZjM9Q=="}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:36.681221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:36.682077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:36.688674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:36.689559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:36.689677 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:36.690348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:36.690808 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:36.691226 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:36.695650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-eb45f884-8635-476d-a741-a6789d6d470b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:46:36.701732 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-eb45f884-8635-476d-a741-a6789d6d470b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:46:36.730403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-eb45f884-8635-476d-a741-a6789d6d470b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062730 Sep 28 08:46:36.730923 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 389/810] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:46:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:36.762924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f250207e16c4515bd9beb9ca4b1fde6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c507f95ba3c34cc789ee8903b40c346d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:36.771223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bec65917-e2e1-410c-85eb-3525c0974155 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 200 len: 1220 microversion: 2.1 time: 0.094525 Sep 28 08:46:36.771978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 422/811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:36 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:37.794820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:37.796018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] [instance: 901f2acc-6433-42cb-a931-82ccde824010] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:37.802696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:37.803324 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:37.803764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:37.804521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:37.808295 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:37.808780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:37.823108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] HTTP exception thrown: Instance 901f2acc-6433-42cb-a931-82ccde824010 could not be found. Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Request method failure captured: Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 HTTP/1.1 Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAh4dlXWrMdkYP7m7DGApcv0HBDqfnPZzRUDu4e1uTARCl4p8sINSONkh2pCP45AWHA79ErMFIneTuRi4mrlHyCb2dhX5usHQXJdIYG_7AD45lnciJWaF10fyQpN60NkK-dcBnzN0XX7PMXaGorqq7KWa_cgW8NAs1tBR4JZo6WC0h4 Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: c507f95ba3c34cc789ee8903b40c346d Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-TestShelveInstance-105249129 Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:46:37.824775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c507f95ba3c34cc789ee8903b40c346d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c507f95ba3c34cc789ee8903b40c346d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c507f95ba3c34cc789ee8903b40c346d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c507f95ba3c34cc789ee8903b40c346d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-TestShelveInstance-105249129 Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: c507f95ba3c34cc789ee8903b40c346d Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-TestShelveInstance-105249129 Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-TestShelveInstance-105249129-project Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 4f250207e16c4515bd9beb9ca4b1fde6 Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-TestShelveInstance-105249129-project Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 901f2acc-6433-42cb-a931-82ccde824010 could not be found. Sep 28 08:46:37.826391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '901f2acc-6433-42cb-a931-82ccde824010'} Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901f2acc-6433-42cb-a931-82ccde824010 could not be found. Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:46:37.830450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901f2acc-6433-42cb-a931-82ccde824010 could not be found. Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901f2acc-6433-42cb-a931-82ccde824010 could not be found. Sep 28 08:46:37.832384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:46:37.833760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Returning 404 to user: Instance 901f2acc-6433-42cb-a931-82ccde824010 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:46:37.833760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-37f0d882-4842-4bfe-a7ab-2abaa7dcf2e8 tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010" status: 404 len: 111 microversion: 2.1 time: 0.035432 Sep 28 08:46:37.833760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 390/812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:37 2022] GET /compute/v2.1/servers/901f2acc-6433-42cb-a931-82ccde824010 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:46:37.996924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-57fc3826-719f-421e-990d-ff434d6c7cfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] Calling method '.version_select at 0x7f984faf4f70>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:38.020135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-57fc3826-719f-421e-990d-ff434d6c7cfe tempest-TestShelveInstance-105249129 tempest-TestShelveInstance-105249129-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1228999444" status: 202 len: 0 microversion: 2.1 time: 0.028133 Sep 28 08:46:38.020642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 423/813] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Sep 28 08:46:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1228999444 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:46:38.091787 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2089265848", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5328add-2390-4470-bd9d-0ff97db6e42c"}], "security_groups": [{"name": "tempest-securitygroup--20919882"}], "key_name": "tempest-keypair-1076186214", "user_data": "}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:38.531807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] validate_networks() for [('b5328add-2390-4470-bd9d-0ff97db6e42c', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:46:39.158560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:46:39.159051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:46:39.159453 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:46:39.159888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:46:39.160514 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:46:39.169331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:39.169820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:39.170891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:39.171882 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:39.172335 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:39.173129 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:39.190276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:46:39.194243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Getting quotas for user 7e3b9ceb95374f1dbf356122c8ed463c and project 6bc96052a69e409498462a1e4d499910. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:46:39.205200 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:46:39.207521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:46:39.257154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3643dc28-8861-492f-941e-ca57c510282f tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.169774 Sep 28 08:46:39.258529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 391/814] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:46:38 2022] POST /compute/v2.1/servers => generated 400 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:46:39.269692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ee7987fc-7d6f-4d7c-b5f3-2b9b7a2bc367 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:39.270354 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ee7987fc-7d6f-4d7c-b5f3-2b9b7a2bc367 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:39.344318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ee7987fc-7d6f-4d7c-b5f3-2b9b7a2bc367 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:39.353052 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ee7987fc-7d6f-4d7c-b5f3-2b9b7a2bc367 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1242 microversion: 2.1 time: 0.086787 Sep 28 08:46:39.365937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 424/815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:39 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:40.377422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:40.378739 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:40.384763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:40.385527 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:40.385955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:40.386663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:40.387108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:40.387652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:40.508734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:40.518074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-96443c47-fb1c-47b3-8a9a-c0fb06eeaad0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1294 microversion: 2.1 time: 0.145027 Sep 28 08:46:40.535021 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 392/816] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:40 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:41.545789 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:41.546686 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:41.557253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:41.559313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:41.559926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:41.561684 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:41.563780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:41.564416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:41.859873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:41.870536 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4e401491-16ba-4fb9-b9d1-f8080e257b21 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.329187 Sep 28 08:46:41.887466 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 425/817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:41 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:42.826571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-95df5e4a-3ed8-42a2-a1e3-041f001339c6 req-fcf069bc-af14-48ee-ad1f-59820d81a55d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b", "tag": "a3ad7883-60b5-4319-9508-c4abe5abf2d6"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:42.838114 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-95df5e4a-3ed8-42a2-a1e3-041f001339c6 req-fcf069bc-af14-48ee-ad1f-59820d81a55d service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:42.838612 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-95df5e4a-3ed8-42a2-a1e3-041f001339c6 req-fcf069bc-af14-48ee-ad1f-59820d81a55d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:42.839037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-95df5e4a-3ed8-42a2-a1e3-041f001339c6 req-fcf069bc-af14-48ee-ad1f-59820d81a55d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:42.852410 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-95df5e4a-3ed8-42a2-a1e3-041f001339c6 req-fcf069bc-af14-48ee-ad1f-59820d81a55d service nova] Creating event network-changed:a3ad7883-60b5-4319-9508-c4abe5abf2d6 for instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b on hv-cinder-84456 Sep 28 08:46:42.858266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-95df5e4a-3ed8-42a2-a1e3-041f001339c6 req-fcf069bc-af14-48ee-ad1f-59820d81a55d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035435 Sep 28 08:46:42.858891 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 393/818] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:46:42.895427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:42.896048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:42.902716 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:42.903503 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:42.903942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:42.905386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:42.905849 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:42.906275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:43.069576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:43.079381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-712607a6-2317-4340-b36c-bfabf9c4b9a7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.187953 Sep 28 08:46:43.080546 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 426/819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:42 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:43.759691 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae331d58-e387-4576-a6bd-5cce1e6db335", "device": "/dev/sdb"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:43.762753 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:43.769555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:43.770036 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:43.770462 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:43.771147 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:43.771596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:43.772019 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:44.066042 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1c08442f-2812-45ca-92ba-118f2bc83ed2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "POST /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311182 Sep 28 08:46:44.067605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 394/820] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:46:43 2022] POST /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:44.103311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:44.104302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:44.112774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:44.113586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:44.114419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:44.115402 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:44.116112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:44.116645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:44.271086 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:44.274627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:44.279841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-20ddf776-c580-4218-8b5a-105d0db1a3f1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.180396 Sep 28 08:46:44.280414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 427/821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:44 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:45.304469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:45.305398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:45.311640 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:45.312076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:45.312514 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:45.313231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:45.313683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:45.314109 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:45.318667 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:45.452467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:45.465469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f59dbfe5-12c2-4297-84fc-b15ba4b730d2 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.165591 Sep 28 08:46:45.466049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 395/822] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:45 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:46.490094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:46.493652 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:46.501328 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:46.502110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:46.502567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:46.503350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:46.503752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:46.504180 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:46.899624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:46.907184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ab21bd9c-f859-4f05-83db-e584e5400728 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.421401 Sep 28 08:46:46.907750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 428/823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:46 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:46:47.930785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:47.931385 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:47.933741 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:47.939738 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:47.940315 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:47.940820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:47.941645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:47.942198 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:47.942711 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:48.073990 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:48.081556 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c1abdf3d-d498-453c-a4eb-c9b50a94acd9 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.154553 Sep 28 08:46:48.082120 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 396/824] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:47 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:49.104634 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:49.105334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:49.108106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:49.114346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:49.114860 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:49.115290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:49.115982 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:49.116428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:49.116841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:49.249693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:49.257333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3aa772ac-eb60-4b6d-9410-79090d50f38b tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.156491 Sep 28 08:46:49.257901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 429/825] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:49 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:49.961870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-26603a8a-8b47-49fd-874a-d74eaff8d22c req-da42fa41-0691-4ef1-b084-fa21d31a7113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b", "name": "network-vif-plugged", "status": "completed", "tag": "a3ad7883-60b5-4319-9508-c4abe5abf2d6"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:49.967366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:49.968744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=10 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:49.978663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-26603a8a-8b47-49fd-874a-d74eaff8d22c req-da42fa41-0691-4ef1-b084-fa21d31a7113 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:49.979154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-26603a8a-8b47-49fd-874a-d74eaff8d22c req-da42fa41-0691-4ef1-b084-fa21d31a7113 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:49.979591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-26603a8a-8b47-49fd-874a-d74eaff8d22c req-da42fa41-0691-4ef1-b084-fa21d31a7113 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:49.991479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-26603a8a-8b47-49fd-874a-d74eaff8d22c req-da42fa41-0691-4ef1-b084-fa21d31a7113 service nova] Creating event network-vif-plugged:a3ad7883-60b5-4319-9508-c4abe5abf2d6 for instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b on hv-cinder-84456 Sep 28 08:46:49.996830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-26603a8a-8b47-49fd-874a-d74eaff8d22c req-da42fa41-0691-4ef1-b084-fa21d31a7113 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038352 Sep 28 08:46:49.997118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 397/826] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:50.279749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:50.280358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:50.282859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:46:50.288495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:50.288977 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:50.289456 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:50.290143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:50.290592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:50.291008 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:50.429264 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:50.436931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-48c8aa2e-d808-4f30-a123-4b0499076d78 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.160994 Sep 28 08:46:50.437551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 430/827] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:50 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:51.461803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:51.462490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:51.469478 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:51.469954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:51.470379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:51.471054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:51.471499 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:51.471919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:51.600948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:51.608658 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-08a47324-6819-416a-bd29-a4cd87450a83 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1366 microversion: 2.1 time: 0.151054 Sep 28 08:46:51.609916 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 398/828] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:51 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:52.632008 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:52.632627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:52.639144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:52.639625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:52.640587 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:52.641295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:52.641749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:52.642174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:52.778175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:46:52.785594 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-afbd6775-f6fd-47b1-8713-89a4acba4371 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1555 microversion: 2.1 time: 0.157562 Sep 28 08:46:52.786152 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 431/829] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:46:52 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:46:52.807776 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:46:52.808399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:46:52.815308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:52.815785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:52.816221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:52.816913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:52.817403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:52.817827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:52.893815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9f7eca58-b634-4e6a-81b7-a5026865c35c tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089864 Sep 28 08:46:52.894409 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 399/830] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Sep 28 08:46:52 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:46:53.853185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-607093c2-6b40-42fb-9d6f-c1b1c6f2144c req-d038023a-2d9d-4355-89ac-174a189ed73c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b", "tag": "a3ad7883-60b5-4319-9508-c4abe5abf2d6"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:46:53.864886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-607093c2-6b40-42fb-9d6f-c1b1c6f2144c req-d038023a-2d9d-4355-89ac-174a189ed73c service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:46:53.865680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-607093c2-6b40-42fb-9d6f-c1b1c6f2144c req-d038023a-2d9d-4355-89ac-174a189ed73c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:46:53.866117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-607093c2-6b40-42fb-9d6f-c1b1c6f2144c req-d038023a-2d9d-4355-89ac-174a189ed73c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:46:53.878385 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-607093c2-6b40-42fb-9d6f-c1b1c6f2144c req-d038023a-2d9d-4355-89ac-174a189ed73c service nova] Creating event network-changed:a3ad7883-60b5-4319-9508-c4abe5abf2d6 for instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b on hv-cinder-84456 Sep 28 08:46:53.884101 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-607093c2-6b40-42fb-9d6f-c1b1c6f2144c req-d038023a-2d9d-4355-89ac-174a189ed73c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034971 Sep 28 08:46:53.885146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 432/831] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:47:13.117324 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=7 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:13.118462 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=23 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:13.122940 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:13.123461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:13.130047 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:13.130533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:13.130970 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:13.131659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:13.132116 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:13.132537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:13.216692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lazy-loading 'services' on Instance uuid bb92ccd6-c465-416c-a715-84efa8668ad2 {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:47:13.288097 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d5ea7b68-7f17-4432-8fb0-eadf1330102e tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2/os-volume_attachments/ae331d58-e387-4576-a6bd-5cce1e6db335" status: 202 len: 0 microversion: 2.1 time: 0.172750 Sep 28 08:47:13.288714 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 400/832] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:47:13 2022] DELETE /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2/os-volume_attachments/ae331d58-e387-4576-a6bd-5cce1e6db335 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:47:14.413176 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=7 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:14.414410 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=26 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:14.419730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:14.420391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:14.427654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:14.428134 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:14.428573 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:14.429946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:14.430398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:14.430820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:14.455347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:47:14.533943 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-210d7c07-4fc5-48f6-b8d0-67c0d3197794 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 204 len: 0 microversion: 2.1 time: 0.121901 Sep 28 08:47:14.534747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 433/833] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:47:14 2022] DELETE /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:47:14.544128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:14.544823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:14.551485 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:14.551966 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:14.552400 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:14.553108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:14.553558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:14.553979 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:14.683014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:14.690633 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-843dc8cf-20f5-463c-b53d-7b13f3a061ea tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1515 microversion: 2.1 time: 0.150712 Sep 28 08:47:14.691189 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 401/834] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:14 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:47:15.715518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:15.716209 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:15.722902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:15.723379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:15.723810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:15.724483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:15.724926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:15.725371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:15.861792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:15.869638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6d0ab3d3-5943-4d25-b992-ce7a5430400b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1515 microversion: 2.1 time: 0.158376 Sep 28 08:47:15.870209 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 434/835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:15 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:16.893650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:16.894298 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:16.902680 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:16.903178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:16.903625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:16.904339 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:16.904811 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:16.905337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:17.034649 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:17.043392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-afa0d7a6-6279-4af5-94f7-8c6cc6c926ba tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 200 len: 1515 microversion: 2.1 time: 0.153582 Sep 28 08:47:17.044337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 402/836] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:16 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:17.192235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-771b3be5-1ee0-40cf-bc04-586f1b8b1364 req-b8c7fc88-c0d8-445b-b5ca-dc76ce3edcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb92ccd6-c465-416c-a715-84efa8668ad2", "name": "network-vif-deleted", "tag": "7401d624-9a08-4c27-a133-b9997af58cd5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:47:17.205506 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-771b3be5-1ee0-40cf-bc04-586f1b8b1364 req-b8c7fc88-c0d8-445b-b5ca-dc76ce3edcfb service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:17.206005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-771b3be5-1ee0-40cf-bc04-586f1b8b1364 req-b8c7fc88-c0d8-445b-b5ca-dc76ce3edcfb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:17.206420 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-771b3be5-1ee0-40cf-bc04-586f1b8b1364 req-b8c7fc88-c0d8-445b-b5ca-dc76ce3edcfb service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:17.218642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-771b3be5-1ee0-40cf-bc04-586f1b8b1364 req-b8c7fc88-c0d8-445b-b5ca-dc76ce3edcfb service nova] Creating event network-vif-deleted:7401d624-9a08-4c27-a133-b9997af58cd5 for instance bb92ccd6-c465-416c-a715-84efa8668ad2 on hv-cinder-84456 Sep 28 08:47:17.225132 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-771b3be5-1ee0-40cf-bc04-586f1b8b1364 req-b8c7fc88-c0d8-445b-b5ca-dc76ce3edcfb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036649 Sep 28 08:47:17.225989 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 435/837] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:47:18.067437 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:18.068001 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: bb92ccd6-c465-416c-a715-84efa8668ad2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:18.075265 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:18.075748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:18.076184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:18.076880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:18.077368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:18.077796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:18.091546 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] HTTP exception thrown: Instance bb92ccd6-c465-416c-a715-84efa8668ad2 could not be found. Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Request method failure captured: Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 HTTP/1.1 Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAnL_XwgPjFUBOPzWLePwbvXko5Erv5k-JrW3FnL-CkgjrErI-qOsX3voLYrRP6dvWJkpt-t42sANlW0y-LdCA9iiKw5_2_Jqfjdsd8tx1dBnutoZ2nn5IyCEH8zfJ303_BCOotbodaEe4RhIDcxde8rAgLtU_-c9KtPoJLHxf-YTW0 Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: bfe1975eab4d4dad9aab52c90493bf7d Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-VolumesSnapshotTestJSON-689340620 Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:47:18.093217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bfe1975eab4d4dad9aab52c90493bf7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfe1975eab4d4dad9aab52c90493bf7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfe1975eab4d4dad9aab52c90493bf7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bfe1975eab4d4dad9aab52c90493bf7d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-VolumesSnapshotTestJSON-689340620 Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: bfe1975eab4d4dad9aab52c90493bf7d Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-689340620 Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-VolumesSnapshotTestJSON-689340620-project Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 5cae6744964d4cabaf0ef00a23057c85 Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-VolumesSnapshotTestJSON-689340620-project Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance bb92ccd6-c465-416c-a715-84efa8668ad2 could not be found. Sep 28 08:47:18.094890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'bb92ccd6-c465-416c-a715-84efa8668ad2'} Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb92ccd6-c465-416c-a715-84efa8668ad2 could not be found. Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:47:18.095991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb92ccd6-c465-416c-a715-84efa8668ad2 could not be found. Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb92ccd6-c465-416c-a715-84efa8668ad2 could not be found. Sep 28 08:47:18.097550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:47:18.099027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Returning 404 to user: Instance bb92ccd6-c465-416c-a715-84efa8668ad2 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:47:18.099027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9178daf6-c84b-4e08-a495-ad0a800ea27a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2" status: 404 len: 111 microversion: 2.1 time: 0.031174 Sep 28 08:47:18.099027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 403/838] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:18 2022] GET /compute/v2.1/servers/bb92ccd6-c465-416c-a715-84efa8668ad2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:47:30.060463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2079676022", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "networks": [{"uuid": "e0943dc5-f513-4bf7-90d4-1fd4b5eef58e"}]}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:47:30.070028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:30.070674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:30.116588 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] validate_networks() for [('e0943dc5-f513-4bf7-90d4-1fd4b5eef58e', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:47:30.469715 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:47:30.470137 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:47:30.470611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:47:30.471017 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:47:30.471427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:47:30.481221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:30.481638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:30.482067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:30.482790 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:30.483242 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:30.483663 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:30.501270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Getting quotas for project bfe1975eab4d4dad9aab52c90493bf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:47:30.505450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Getting quotas for user 5cae6744964d4cabaf0ef00a23057c85 and project bfe1975eab4d4dad9aab52c90493bf7d. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:47:30.516465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:47:30.518948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:47:30.567497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0bfe8507-8255-4f44-9978-baf1b3faec2a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511339 Sep 28 08:47:30.568147 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 436/839] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:47:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:47:30.579590 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1c495f73-40d7-4d18-8146-8de372a21e42 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:30.580430 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1c495f73-40d7-4d18-8146-8de372a21e42 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:30.582870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=8 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:30.583594 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:30.638022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1c495f73-40d7-4d18-8146-8de372a21e42 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:30.646214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1c495f73-40d7-4d18-8146-8de372a21e42 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1219 microversion: 2.1 time: 0.070696 Sep 28 08:47:30.646796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 404/840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:30 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:31.669610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:31.670156 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:31.676776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:31.677298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:31.677738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:31.678638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:31.679709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:31.680146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:31.751493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:31.759790 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-65de8d2f-7782-4943-a288-c54b17d29dde tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1279 microversion: 2.1 time: 0.094698 Sep 28 08:47:31.760373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 437/841] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:31 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:32.058928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:32.059630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:32.066624 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:32.067106 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:32.067529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:32.068218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:32.068664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:32.069081 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:32.093986 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a1bd0ca6-b60f-4d83-b010-14d7ea345f97 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/ips" status: 200 len: 152 microversion: 2.20 time: 0.038955 Sep 28 08:47:32.094560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 405/842] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Sep 28 08:47:32 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:47:32.784440 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:32.785109 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:32.792143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:32.792637 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:32.793110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:32.793816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:32.794268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:32.794697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:32.924973 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:32.932622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f6017070-ad80-45ed-8e39-24eda945776a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.153352 Sep 28 08:47:32.933212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 438/843] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:32 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:33.080668 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-b35ca6c4-241a-409e-87f0-64ac4f2f1c3d req-2ab4c306-97b8-42aa-9cdc-286d34e49d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16601fb4-a1c0-44b2-a623-6ec03fd1adc8", "tag": "79ccb1f9-8ae2-4618-9acb-3c19b76345c3"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:47:33.091441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b35ca6c4-241a-409e-87f0-64ac4f2f1c3d req-2ab4c306-97b8-42aa-9cdc-286d34e49d5c service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:33.091917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b35ca6c4-241a-409e-87f0-64ac4f2f1c3d req-2ab4c306-97b8-42aa-9cdc-286d34e49d5c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:33.092589 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b35ca6c4-241a-409e-87f0-64ac4f2f1c3d req-2ab4c306-97b8-42aa-9cdc-286d34e49d5c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:33.103912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-b35ca6c4-241a-409e-87f0-64ac4f2f1c3d req-2ab4c306-97b8-42aa-9cdc-286d34e49d5c service nova] Creating event network-changed:79ccb1f9-8ae2-4618-9acb-3c19b76345c3 for instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 on hv-cinder-84456 Sep 28 08:47:33.108856 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-b35ca6c4-241a-409e-87f0-64ac4f2f1c3d req-2ab4c306-97b8-42aa-9cdc-286d34e49d5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Sep 28 08:47:33.109503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 406/844] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:47:33.890099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:47:33.890639 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:33.896912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:33.898052 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:33.898492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:33.899174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:33.899622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:33.900050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:33.921918 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lazy-loading 'flavor' on Instance uuid f01e6e1b-84cf-44b2-85ec-dba5603c76ae {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:47:33.955871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:33.956563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:33.963274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:33.963753 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:33.964188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:33.964913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:33.965395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:33.965814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:34.098364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:34.106067 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-27f971f4-987c-4309-9be4-35798f0f6830 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.154306 Sep 28 08:47:34.106630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 407/845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:33 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:47:34.112690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-857ce7ec-c136-4e90-854e-f8442c643d5d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/action" status: 202 len: 0 microversion: 2.20 time: 0.226397 Sep 28 08:47:34.113352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 439/846] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 08:47:33 2022] POST /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:47:34.121199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:34.121887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:34.127700 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:34.128176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:34.128609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:34.129334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:34.129785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:34.130203 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:34.263120 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:34.271022 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:34.272956 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:34.274142 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-84edc4ad-b131-4b82-812e-0f509b2f66e3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.156700 Sep 28 08:47:34.274699 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 408/847] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:34 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:35.133579 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:35.134284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:35.140636 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:35.141149 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:35.141592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:35.142280 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:35.142735 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:35.143153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:35.270255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:35.277964 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d5839b1c-4004-4021-b972-aba53910e9a6 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.149812 Sep 28 08:47:35.278529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 440/848] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:35 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:35.300211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:35.300827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:35.307826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:35.308310 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:35.308749 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:35.309474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:35.309927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:35.310351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:35.441782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:35.450122 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:35.451551 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:35.452696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3df964cf-c3b3-443a-b0da-fbf4867a6f83 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.156705 Sep 28 08:47:35.453277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 409/849] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:35 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:36.301405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:36.302045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:36.308538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:36.309023 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:36.309492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:36.310180 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:36.310632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:36.311055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:36.440093 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:36.448268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b32f0d31-b244-4e00-980b-2e3980123bbe tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.151031 Sep 28 08:47:36.448832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 441/850] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:36 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:36.478150 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:36.478757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:36.485148 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:36.485638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:36.486076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:36.486764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:36.487217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:36.487640 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:36.621863 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:36.630286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:36.631789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:36.633481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f3b95556-44ed-49a1-af85-3cae08a50d20 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.159236 Sep 28 08:47:36.634133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 410/851] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:36 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:37.471013 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:37.471765 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:37.478633 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:37.479113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:37.479549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:37.480238 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:37.480694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:37.481151 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:37.615721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:37.624491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cb092087-9357-4886-9946-0e1190f4ef0c tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.157310 Sep 28 08:47:37.625055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 442/852] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:37 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:37.659497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:37.660103 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:37.666510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:37.666995 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:37.667434 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:37.668126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:37.668580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:37.669005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:37.803485 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:37.811489 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:37.812930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:37.814117 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d8c131c9-c1fa-4d0a-b44c-7bd42a58074c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.158533 Sep 28 08:47:37.814672 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 411/853] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:37 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:38.648099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:38.648785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:38.655444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:38.655933 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:38.656373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:38.657067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:38.657571 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:38.657993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:38.789404 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:38.797070 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-553a40d7-9be7-4142-b3cd-2921b5565009 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.153242 Sep 28 08:47:38.797854 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 443/854] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:38 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:38.841694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:38.842291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:38.848555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:38.849023 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:38.849481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:38.850167 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:38.851183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:38.851603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:38.978751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:38.986826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:38.988272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:38.989461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a2624b9b-9a65-4d6b-998c-52680c1b57b9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.151821 Sep 28 08:47:38.997357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 412/855] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:38 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:39.821492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:39.822041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:39.828236 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:39.828707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:39.829160 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:39.829841 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:39.830284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:39.830699 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:39.960869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:39.968364 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-031fe7e7-b023-4257-9a09-21dba9a93935 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.151516 Sep 28 08:47:39.968919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 444/856] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:39 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:40.014687 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:40.015287 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:40.021537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:40.022017 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:40.022493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:40.023184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:40.023680 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:40.024053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:40.150109 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:40.158105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:40.159533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:40.160676 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ece3e375-6d0f-41e8-9398-68fe3a9babec tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.150034 Sep 28 08:47:40.161257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 413/857] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:40 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:40.489432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-4609efd6-624c-442f-a109-61d59a00b159 req-da9d9d8d-43e8-411b-80f0-14624b8d3368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16601fb4-a1c0-44b2-a623-6ec03fd1adc8", "name": "network-vif-plugged", "status": "completed", "tag": "79ccb1f9-8ae2-4618-9acb-3c19b76345c3"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:47:40.494754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:40.500940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-4609efd6-624c-442f-a109-61d59a00b159 req-da9d9d8d-43e8-411b-80f0-14624b8d3368 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:40.501445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-4609efd6-624c-442f-a109-61d59a00b159 req-da9d9d8d-43e8-411b-80f0-14624b8d3368 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:40.501876 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-4609efd6-624c-442f-a109-61d59a00b159 req-da9d9d8d-43e8-411b-80f0-14624b8d3368 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:40.511579 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:40.514241 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-4609efd6-624c-442f-a109-61d59a00b159 req-da9d9d8d-43e8-411b-80f0-14624b8d3368 service nova] Creating event network-vif-plugged:79ccb1f9-8ae2-4618-9acb-3c19b76345c3 for instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 on hv-cinder-84456 Sep 28 08:47:40.519540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-4609efd6-624c-442f-a109-61d59a00b159 req-da9d9d8d-43e8-411b-80f0-14624b8d3368 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034096 Sep 28 08:47:40.520488 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 445/858] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:47:40.992594 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:40.993227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:40.995191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:41.000859 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:41.001364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:41.001797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:41.002472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:41.002915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:41.003331 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:41.136626 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:41.144105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ecdcdd6b-aaf9-4888-aa7e-0b2d4746eb6a tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.155877 Sep 28 08:47:41.144664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 414/859] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:40 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:41.187360 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:41.188061 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:41.196085 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:41.196565 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:41.196998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:41.197732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:41.198187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:41.198611 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:41.328990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:41.337060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:41.338535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:41.339728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7235e728-97ae-49e1-90e9-bdcd15a78a0c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.157104 Sep 28 08:47:41.340284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 446/860] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:41 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:42.167457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:42.168014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:42.174724 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:42.175210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:42.175644 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:42.176341 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:42.176790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:42.177242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:42.309291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:42.317026 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3a091d08-6a61-4cf6-979c-1f5e00ea905b tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1319 microversion: 2.1 time: 0.154153 Sep 28 08:47:42.317628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 415/861] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:42 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:42.367047 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:42.367710 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:42.374811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:42.375358 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:42.375827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:42.376577 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:42.377033 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:42.377489 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:42.520972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:42.530456 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:42.531931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:42.533111 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-05d97b5a-7aa3-4fca-97b6-318e9ff7853d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.170913 Sep 28 08:47:42.533659 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 447/862] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:42 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:43.340426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:43.341033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:43.347415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:43.347895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:43.348329 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:43.349023 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:43.349502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:43.349923 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:43.478152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:43.485902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-31746621-7cca-4c74-9a51-76f77700f584 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1508 microversion: 2.1 time: 0.149408 Sep 28 08:47:43.486460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 416/863] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:47:43 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:47:43.508000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e476f188-3a37-4655-86c6-93d581286aed", "device": "/dev/sdb"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:47:43.510988 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:43.517196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:43.517687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:43.518125 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:43.518816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:43.519266 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:43.519687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:43.558912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:43.559520 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:43.565219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:43.565710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:43.566138 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:43.566822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:43.567268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:43.567688 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:43.700396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:43.708788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:43.710905 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:43.712133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-df7ca495-24c6-4bd6-97af-f08bfc62043c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.157084 Sep 28 08:47:43.712993 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 417/864] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:43 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:47:43.795154 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5e7302f5-0902-41fd-9400-aa66c30eef45 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "POST /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290991 Sep 28 08:47:43.795803 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 448/865] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:47:43 2022] POST /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:47:44.737677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:44.738220 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:44.745530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:44.746010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:44.746440 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:44.747132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:44.747578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:44.747994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:44.875992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:44.884914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:44.886526 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:44.887687 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6b0f9582-8369-42fa-98ba-6d1041a4ea84 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.154020 Sep 28 08:47:44.888428 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 418/866] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:44 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:45.914337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:45.914954 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:45.921104 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:45.921599 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:45.922071 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:45.923015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:45.923470 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:45.923906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:46.051258 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:46.059536 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:46.061660 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:46.062832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2f038202-8b29-4767-9979-8be816e9ad61 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.153481 Sep 28 08:47:46.063388 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 449/867] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:45 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:47:47.098674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:47.099380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:47.109628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:47.110127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:47.110570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:47.111281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:47.111744 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:47.112169 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:47.253835 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:47.262598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:47.264055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:47.265262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f33bd6ab-d76e-459f-b0ca-f224516b6dde tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.172284 Sep 28 08:47:47.265823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 419/868] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:47 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:48.290923 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:48.291535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:48.298221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:48.298653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:48.299092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:48.299788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:48.300236 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:48.300662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:48.318996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:48.434462 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:48.442451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:48.443905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:48.445040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1a6ad132-b78a-4f3b-ba91-be5ea7759c7e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.158552 Sep 28 08:47:48.445616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 450/869] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:48 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:49.470707 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:49.471321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:49.478402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:49.478887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:49.479326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:49.480020 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:49.480475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:49.480900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:49.610507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:49.618646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:49.620095 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:49.621290 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-dd3a5f57-2090-42cd-84ed-cbc0c32fd96d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.154510 Sep 28 08:47:49.621855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 420/870] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:49 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:50.647748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:50.648348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:50.654831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:50.655313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:50.655744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:50.656428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:50.656896 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:50.657345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:50.784180 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:50.793425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:50.794878 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:50.796079 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f64828d4-aa7d-412b-b694-1decc558805e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.152757 Sep 28 08:47:50.796638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 451/871] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:50 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:51.822651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:51.823189 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:51.829836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:51.830326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:51.830763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:51.831462 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:51.831918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:51.832347 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:51.962997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:51.971247 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:51.972714 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:51.973899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-72cd9888-5518-4a21-80a4-ffbb897b2c32 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.155361 Sep 28 08:47:51.974464 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 421/872] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:51 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:52.535910 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-81c66a39-ff06-4d09-810d-c330f375399a req-57db790d-8727-4887-92db-8bd64608ef00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01e6e1b-84cf-44b2-85ec-dba5603c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "4d6b9373-73e3-4bd1-aca0-9a1bba180a33"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:47:52.546768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81c66a39-ff06-4d09-810d-c330f375399a req-57db790d-8727-4887-92db-8bd64608ef00 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:52.547235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81c66a39-ff06-4d09-810d-c330f375399a req-57db790d-8727-4887-92db-8bd64608ef00 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:52.547920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81c66a39-ff06-4d09-810d-c330f375399a req-57db790d-8727-4887-92db-8bd64608ef00 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:52.559051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-81c66a39-ff06-4d09-810d-c330f375399a req-57db790d-8727-4887-92db-8bd64608ef00 service nova] Creating event network-vif-plugged:4d6b9373-73e3-4bd1-aca0-9a1bba180a33 for instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae on hv-cinder-84456 Sep 28 08:47:52.564045 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-81c66a39-ff06-4d09-810d-c330f375399a req-57db790d-8727-4887-92db-8bd64608ef00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031886 Sep 28 08:47:52.564700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 452/873] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:47:53.005715 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:53.006269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:53.013617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:53.014108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:53.014548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:53.015255 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:53.015714 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:53.016139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:53.036603 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:47:53.152119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:53.160338 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:53.161827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:53.162983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bf4c5ce2-3698-4617-a9b4-dfe9dc8b09f7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.165652 Sep 28 08:47:53.163536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 422/874] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:52 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:54.190246 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:54.190946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:54.197615 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:54.198099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:54.198535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:54.199224 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:54.199683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:54.200108 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:54.332252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:54.340940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:54.342423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:54.343595 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ec48d596-30b8-417a-ad38-b4d4bb230d24 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.158237 Sep 28 08:47:54.344158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 453/875] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:54 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:55.369243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:55.369861 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:55.376342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:55.376821 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:55.377288 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:55.378040 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:55.378549 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:55.378973 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:55.511779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:55.520242 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:55.521739 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:55.523413 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-72f3de16-a339-4297-96f0-1f53da372ed5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.158241 Sep 28 08:47:55.523971 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 423/876] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:55 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:56.549336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:56.549945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:56.557055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:56.557542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:56.557978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:56.558666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:56.559113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:56.559533 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:56.691297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:56.700682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:56.702171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:56.703343 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3abd6d54-e304-4929-8459-4c95b8fc8638 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.158268 Sep 28 08:47:56.703899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 454/877] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:56 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:57.729620 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:57.730231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:57.736799 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:57.737326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:57.737766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:57.738458 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:57.738914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:57.739348 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:58.065426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:58.073403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:58.074856 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:58.076017 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8049dc45-260e-4e2e-bdbe-9bf27977bb27 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.350357 Sep 28 08:47:58.076580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 424/878] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:57 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:47:59.101522 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:47:59.102069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:47:59.108423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:59.108894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:59.109355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:59.110037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:47:59.110475 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:47:59.110889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:47:59.296151 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:59.304953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:59.306414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:47:59.307563 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c170486f-d17d-48ed-b276-c29be6857ca8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.210150 Sep 28 08:47:59.308114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 455/879] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:47:59 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:00.332624 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:00.333257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:00.339797 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:00.340277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:00.340710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:00.341422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:00.341877 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:00.342306 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:00.472840 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:00.480831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:00.482313 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:00.483468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6f336b1f-0259-4cb0-ad8a-5287873ddb8a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.154940 Sep 28 08:48:00.484019 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 425/880] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:00 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:01.509021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:01.509662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:01.512129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:01.517770 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:01.518259 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:01.518698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:01.519398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:01.519857 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:01.520282 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:01.655153 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:01.663126 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:01.664550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:01.665730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-daa7e911-7a0a-48cf-9752-91b5f5b30424 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.160623 Sep 28 08:48:01.666282 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 456/881] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:01 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:02.691486 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:02.692078 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:02.694454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=47 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:02.699537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:02.700014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:02.700447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:02.701160 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:02.701612 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:02.702029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:02.833243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:02.841735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:02.843224 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:02.844369 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-304f7d53-2600-49a9-8fa4-9443e5d3abac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.156820 Sep 28 08:48:02.844927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 426/882] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:02 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:03.870926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:03.871472 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:03.878003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:03.878490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:03.878928 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:03.879627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:03.880080 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:03.880508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:04.020068 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:04.028632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:04.030432 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:04.032063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0e4e34cc-d11b-4b94-87be-672fe7b7d286 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1744 microversion: 2.20 time: 0.165156 Sep 28 08:48:04.037443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 457/883] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:03 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:05.067785 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:05.068442 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:05.075712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:05.076199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:05.076636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:05.077365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:05.078045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:05.078475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:05.246793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:05.255676 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:05.257833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:05.259805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-94513048-2dac-4354-864f-441a9f372d4a tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.199085 Sep 28 08:48:05.260479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 427/884] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:05 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:06.286998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:06.288238 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:06.297207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:06.298748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:06.299370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:06.300359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:06.301121 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:06.301694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:06.477955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:06.486530 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:06.488255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:06.489454 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-20168f01-622b-4559-8230-5233e2da7e3e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.207462 Sep 28 08:48:06.497133 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 458/885] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:06 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:07.400784 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:07.401475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:07.408199 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:07.408701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:07.409200 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:07.409919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:07.411207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:07.411650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:07.511822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lazy-loading 'services' on Instance uuid 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:48:07.516316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:07.516938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:07.524572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:07.525069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:07.525537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:07.526242 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:07.526694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:07.527692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:07.607109 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e075baac-22df-48e9-bb01-6f82408ceef5 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8/os-volume_attachments/e476f188-3a37-4655-86c6-93d581286aed" status: 202 len: 0 microversion: 2.1 time: 0.210597 Sep 28 08:48:07.608404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 428/886] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:48:07 2022] DELETE /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8/os-volume_attachments/e476f188-3a37-4655-86c6-93d581286aed => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:48:07.722550 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:07.732311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:07.734130 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:07.735632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-48289688-fd3e-472f-833b-d2cf77ebf797 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.223632 Sep 28 08:48:07.749632 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 459/887] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:07 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:48:08.769562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:08.770401 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:08.775661 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:08.776207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:08.784177 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:08.784654 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:08.784793 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:08.785299 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:08.785582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:08.786648 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:08.786832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:08.787352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:08.789271 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:08.789401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:08.789401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:08.789401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:08.831737 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:48:08.950091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:08.960662 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:08.962810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:08.964488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ed3fe5aa-77aa-4b9f-a8c6-6a4dcd2428c2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.200164 Sep 28 08:48:08.981305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2790a84f-2a16-4448-89c0-519996c97b64 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "DELETE /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 204 len: 0 microversion: 2.1 time: 0.199378 Sep 28 08:48:08.981305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 460/888] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:48:08 2022] DELETE /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 28 08:48:08.982460 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 429/889] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:08 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:08.993992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:08.996624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:09.008982 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:09.010442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:09.012205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:09.014399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:09.014869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:09.015416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:09.184415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:09.193362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6e0d7bed-0db5-4635-85af-fc58995e683f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1514 microversion: 2.1 time: 0.217542 Sep 28 08:48:09.193980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 461/890] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:08 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:48:09.994431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:09.995108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:10.001991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:10.002510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:10.002976 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:10.003705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:10.004182 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:10.004604 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:10.158201 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:10.167099 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:10.169008 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:10.170497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-293c7018-f9bb-43ab-83cc-7a33c13eef8b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.179996 Sep 28 08:48:10.171254 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 430/891] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:09 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:10.216394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:10.217265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:10.224721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:10.225515 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:10.226030 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:10.226792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:10.227362 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:10.227874 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:10.388925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:10.397971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dd04398a-fe84-443e-833b-f26edb0b0b0f tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1514 microversion: 2.1 time: 0.185294 Sep 28 08:48:10.398761 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 462/892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:10 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:48:11.198525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:11.199759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:11.208067 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:11.208856 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:11.210035 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:11.210990 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:11.211611 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:11.212201 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:11.364826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:11.373926 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:11.375814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:11.377232 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-025f2c6f-f9bb-4d64-99fa-fae5fe03d1c9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.182586 Sep 28 08:48:11.393823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 431/893] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:11 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:11.421916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:11.422525 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:11.432359 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:11.432854 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:11.433330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:11.434187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:11.434643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:11.435064 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:11.611055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:11.621258 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4a0bd0d6-2a0d-4ffc-bada-deab8d799c40 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1514 microversion: 2.1 time: 0.202205 Sep 28 08:48:11.637706 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 463/894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:11 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:48:12.015055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-019685df-396d-4082-bbc8-7784dfe28e35 req-687d012d-d829-4a6b-968b-85d2efc0d4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16601fb4-a1c0-44b2-a623-6ec03fd1adc8", "name": "network-vif-deleted", "tag": "79ccb1f9-8ae2-4618-9acb-3c19b76345c3"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:48:12.034240 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-019685df-396d-4082-bbc8-7784dfe28e35 req-687d012d-d829-4a6b-968b-85d2efc0d4a3 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:12.035016 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-019685df-396d-4082-bbc8-7784dfe28e35 req-687d012d-d829-4a6b-968b-85d2efc0d4a3 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:12.035611 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-019685df-396d-4082-bbc8-7784dfe28e35 req-687d012d-d829-4a6b-968b-85d2efc0d4a3 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:12.049533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-019685df-396d-4082-bbc8-7784dfe28e35 req-687d012d-d829-4a6b-968b-85d2efc0d4a3 service nova] Creating event network-vif-deleted:79ccb1f9-8ae2-4618-9acb-3c19b76345c3 for instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 on hv-cinder-84456 Sep 28 08:48:12.058126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-019685df-396d-4082-bbc8-7784dfe28e35 req-687d012d-d829-4a6b-968b-85d2efc0d4a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045750 Sep 28 08:48:12.059560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 432/895] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:48:12.405427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:12.406316 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:12.413447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:12.414053 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:12.414562 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:12.415374 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:12.415967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:12.416497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:12.574924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:12.586448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:12.587935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:12.589119 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-032553c6-b3e3-483e-9a39-59ba19112e14 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.187903 Sep 28 08:48:12.589944 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 464/896] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:12 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:12.648222 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:12.649769 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:12.657780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:12.658599 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:12.659033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:12.659904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:12.660540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:12.660967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:12.696525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:12.697069 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:12.697588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:12.698051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lazy-loading 'fault' on Instance uuid 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:48:12.742756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cae6744964d4cabaf0ef00a23057c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe1975eab4d4dad9aab52c90493bf7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:12.751748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-afa70e8b-d980-4a95-8c9b-d084356126c2 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 200 len: 1309 microversion: 2.1 time: 0.109334 Sep 28 08:48:12.752658 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 433/897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:12 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:48:13.615254 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:13.616409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:13.624449 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:13.624963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:13.625602 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:13.626317 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:13.626777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:13.627202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:13.775091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:13.776325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] [instance: 16601fb4-a1c0-44b2-a623-6ec03fd1adc8] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:13.783387 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:13.783870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:13.784302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:13.784961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:13.785139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:13.785478 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:13.786104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:13.797194 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:13.800402 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:13.800908 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] HTTP exception thrown: Instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 could not be found. Sep 28 08:48:13.801823 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2b17e205-e096-4fbe-9eaf-4e566c10d782 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.190482 Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Request method failure captured: Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 HTTP/1.1 Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAnL_XwgPjFUBOPzWLePwbvXko5Erv5k-JrW3FnL-CkgjrErI-qOsX3voLYrRP6dvWJkpt-t42sANlW0y-LdCA9iiKw5_2_Jqfjdsd8tx1dBnutoZ2nn5IyCEH8zfJ303_BCOotbodaEe4RhIDcxde8rAgLtU_-c9KtPoJLHxf-YTW0 Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: bfe1975eab4d4dad9aab52c90493bf7d Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-VolumesSnapshotTestJSON-689340620 Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:48:13.803694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bfe1975eab4d4dad9aab52c90493bf7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfe1975eab4d4dad9aab52c90493bf7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bfe1975eab4d4dad9aab52c90493bf7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bfe1975eab4d4dad9aab52c90493bf7d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-VolumesSnapshotTestJSON-689340620 Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: bfe1975eab4d4dad9aab52c90493bf7d Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-689340620 Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-VolumesSnapshotTestJSON-689340620-project Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 5cae6744964d4cabaf0ef00a23057c85 Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-VolumesSnapshotTestJSON-689340620-project Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 could not be found. Sep 28 08:48:13.805112 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '16601fb4-a1c0-44b2-a623-6ec03fd1adc8'} Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 could not be found. Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:48:13.805899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 could not be found. Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 could not be found. Sep 28 08:48:13.807180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:48:13.809040 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] Returning 404 to user: Instance 16601fb4-a1c0-44b2-a623-6ec03fd1adc8 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:48:13.810210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a0a21d86-7e65-476a-b9c3-7b555ba6a317 tempest-VolumesSnapshotTestJSON-689340620 tempest-VolumesSnapshotTestJSON-689340620-project] 10.222.0.52 "GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8" status: 404 len: 111 microversion: 2.1 time: 0.038934 Sep 28 08:48:13.814792 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 434/898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:13 2022] GET /compute/v2.1/servers/16601fb4-a1c0-44b2-a623-6ec03fd1adc8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 08:48:13.839476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 465/899] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:13 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:14.831584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:14.832133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:14.838959 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:14.839431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:14.839860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:14.840540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:14.840983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:14.841423 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:15.128072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:15.136503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:15.137959 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:15.139113 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2ba7219a-cd2c-4381-a9c0-fb87da308109 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1739 microversion: 2.20 time: 0.311623 Sep 28 08:48:15.139659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 435/900] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:14 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:16.166400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:16.167043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:16.173843 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:16.174330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:16.174771 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:16.175469 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:16.175927 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:16.176357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:16.180480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:16.308623 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:16.316680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:16.318168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:16.319328 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-80d33a4b-3550-428a-80e6-8afe282ff503 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1721 microversion: 2.20 time: 0.157564 Sep 28 08:48:16.319885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 466/901] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:16 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:17.345367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:17.346010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:17.352788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:17.353302 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:17.353743 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:17.354429 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:17.354883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:17.355300 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:17.490055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:17.498735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:17.500160 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:17.501358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-97aede0f-a7ec-4aa7-9f43-d9c2786ecfa0 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1721 microversion: 2.20 time: 0.159915 Sep 28 08:48:17.501901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 436/902] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:17 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:18.526054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:18.526666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:18.533129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:18.533559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:18.533995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:18.534681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:18.535130 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:18.535553 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:18.661525 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:18.669448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:18.670921 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:18.672074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bfffbb83-ff42-4314-b6da-902333ea9628 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1721 microversion: 2.20 time: 0.149958 Sep 28 08:48:18.672643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 467/903] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:18 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:19.583695 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-38d2bac9-bada-4306-89ba-6d5d402c1ba0 req-3f9d0016-aff6-458e-a7e1-a32ae7137646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01e6e1b-84cf-44b2-85ec-dba5603c76ae", "name": "network-vif-unplugged", "status": "completed", "tag": "4d6b9373-73e3-4bd1-aca0-9a1bba180a33"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:48:19.595351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-38d2bac9-bada-4306-89ba-6d5d402c1ba0 req-3f9d0016-aff6-458e-a7e1-a32ae7137646 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:19.595901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-38d2bac9-bada-4306-89ba-6d5d402c1ba0 req-3f9d0016-aff6-458e-a7e1-a32ae7137646 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:19.596694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-38d2bac9-bada-4306-89ba-6d5d402c1ba0 req-3f9d0016-aff6-458e-a7e1-a32ae7137646 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:19.618501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-38d2bac9-bada-4306-89ba-6d5d402c1ba0 req-3f9d0016-aff6-458e-a7e1-a32ae7137646 service nova] Creating event network-vif-unplugged:4d6b9373-73e3-4bd1-aca0-9a1bba180a33 for instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae on hv-cinder-84456 Sep 28 08:48:19.627419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-38d2bac9-bada-4306-89ba-6d5d402c1ba0 req-3f9d0016-aff6-458e-a7e1-a32ae7137646 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047153 Sep 28 08:48:19.628507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 437/904] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:48:19.698393 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:19.699014 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:19.705513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:19.705990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:19.706423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:19.707104 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:19.707547 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:19.707965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:19.843556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:19.852013 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:19.853492 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:19.854662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e326ccb1-0e8d-4545-8293-ccd58ed45c96 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1721 microversion: 2.20 time: 0.160149 Sep 28 08:48:19.865512 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 468/905] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:19 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:20.882050 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:20.882754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:20.889420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:20.889911 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:20.890354 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:20.891049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:20.891508 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:20.891933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:21.292448 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:21.300707 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:21.302186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:21.303398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8e0dce19-7395-4d4c-b57b-ea34c57e8bd6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1664 microversion: 2.20 time: 0.426735 Sep 28 08:48:21.303965 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 438/906] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:20 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1664 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:21.329294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a2bbfe6-4948-4bc2-af20-733afbbdb803"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:48:21.331698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:21.338712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:21.339196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:21.339633 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:21.340328 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:21.340780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:21.341289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:21.398277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:21.398677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:21.404436 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:21.404919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:21.405406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:21.406093 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:21.406546 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:21.406968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:21.433161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-36c80302-267a-4bc6-84e4-b371e5071738 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/ips" status: 200 len: 145 microversion: 2.1 time: 0.039393 Sep 28 08:48:21.437308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 439/907] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:48:21 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:48:21.629718 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b00e127c-7d9f-4798-aa59-a9b4734ef4d5 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304419 Sep 28 08:48:21.636695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 469/908] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Sep 28 08:48:21 2022] POST /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 28 08:48:21.778217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:21.778778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:21.784812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:21.785381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:21.785787 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:21.786476 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:21.787441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:21.787869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:21.805812 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:22.095656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e7ec2e3c-546c-4fdc-984d-0b0eab2c5a2c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-volume_attachments/2a2bbfe6-4948-4bc2-af20-733afbbdb803" status: 202 len: 0 microversion: 2.20 time: 0.321547 Sep 28 08:48:22.096353 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 440/909] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Sep 28 08:48:21 2022] DELETE /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-volume_attachments/2a2bbfe6-4948-4bc2-af20-733afbbdb803 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:48:22.156908 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:48:22.157524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:22.164396 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:22.164882 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:22.165361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:22.166054 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:22.166508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:22.166941 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:22.196187 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127111) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 28 08:48:22.269003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-5b981266-56f1-4cf2-8df5-ce37d61c99af tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "POST /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/action" status: 202 len: 0 microversion: 2.20 time: 0.115820 Sep 28 08:48:22.269566 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 470/910] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Sep 28 08:48:22 2022] POST /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:48:22.278296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:22.278915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:22.284908 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:22.285435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:22.285877 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:22.286580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:22.287624 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:22.288056 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:22.422922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:22.431168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:22.432602 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:22.433786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-11f7ea21-2f52-462a-83bb-d5ec9e34e855 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1672 microversion: 2.20 time: 0.159464 Sep 28 08:48:22.434491 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 441/911] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:22 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:48:22.806281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3e6ae1c-ab4a-4bd1-8a6f-2192ed198549"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:48:22.809030 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:22.815142 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:22.815721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:22.816068 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:22.816763 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:22.817247 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:22.817676 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:23.117510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-777b7ea8-13a2-4461-837f-7cb83c7588e0 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316938 Sep 28 08:48:23.118128 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 471/912] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:48:22 2022] POST /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:48:23.461533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:23.462618 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:23.469754 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:23.470379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:23.470817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:23.471652 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:23.472312 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:23.472737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:23.627481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:23.635650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:23.637111 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:23.638295 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-707b72b2-2101-4178-bf58-681282a0bfd8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.182429 Sep 28 08:48:23.638841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 442/913] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:23 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:24.666979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:24.667681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:24.674582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:24.675078 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:24.675686 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:24.676196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:24.676631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:24.677143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:24.850139 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:24.858963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:24.861044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:24.862698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-daa15398-d2e2-4d81-9772-f6921008e97d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.202368 Sep 28 08:48:24.863594 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 472/914] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:24 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:48:25.888733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:25.889308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:25.897445 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:25.897931 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:25.898365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:25.899055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:25.901004 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:25.901004 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:26.028716 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:26.036613 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:26.038062 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:26.039210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bfec632b-800a-483a-987a-76df2e072f56 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.154763 Sep 28 08:48:26.039745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 443/915] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:25 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:27.064901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:27.065529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:27.072387 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:27.072869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:27.073336 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:27.074024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:27.074477 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:27.074900 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:27.206159 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:27.215034 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:27.216474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:27.217666 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8256c8a3-8f11-46b5-aed9-6ee0464309aa tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.156700 Sep 28 08:48:27.218221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 473/916] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:27 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:28.243949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:28.244884 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:28.251717 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:28.252529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:28.253027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:28.253823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:28.254368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:28.254987 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:28.394398 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:28.402900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:28.404330 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:28.405509 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a3cd68b6-da09-4a18-b21a-393238a2b391 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.165598 Sep 28 08:48:28.406049 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 444/917] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:28 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:29.432670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:29.433521 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:29.440390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:29.441118 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:29.441617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:29.443037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:29.443507 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:29.443941 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:29.628220 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:29.637280 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:29.638994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:29.640255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8a9622b1-7de3-40e5-860e-f4cdf7051ab3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.211727 Sep 28 08:48:29.641035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 474/918] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:29 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:30.667932 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:30.669206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:30.676227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:30.676751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:30.677907 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:30.678511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:30.678967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:30.679395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:30.817164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:30.826562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:30.828119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:30.829368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-caf8a8bb-32b4-4ac7-bd66-b820790aa55c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.165459 Sep 28 08:48:30.829918 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 445/919] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:30 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:31.854344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:31.855175 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:31.866497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:31.868549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:31.869046 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:31.869670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:31.870386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:31.870836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:31.871259 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:32.016389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:32.025929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:32.027381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:32.028683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c9ba5a6e-37be-4067-ae39-e41747cf5375 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.178255 Sep 28 08:48:32.041160 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 475/920] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:31 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:33.055791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:33.057016 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:33.060499 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=42 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:33.065364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:33.065855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:33.066481 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:33.067915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:33.068537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:33.068960 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:33.262146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:33.283598 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:33.287869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:33.290349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-94d1eedb-15aa-43c3-8501-38366c1811f9 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.237954 Sep 28 08:48:33.306414 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 446/921] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:33 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:34.337610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:34.339286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:34.363294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:34.363789 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:34.364711 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:34.365478 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:34.365925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:34.366347 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:34.528395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:34.538901 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:34.540376 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:34.541806 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a0653e81-be1a-4285-a7f8-3d2c0f8d1e2d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.219415 Sep 28 08:48:34.542884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 476/922] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:34 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:35.572715 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:35.573387 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:35.579283 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:35.579759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:35.580189 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:35.580878 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:35.581356 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:35.581779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:35.726165 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:35.735632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:35.737209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:35.738471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-53f14a10-d8c2-44a4-85cd-2ae7c897f796 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.172346 Sep 28 08:48:35.739516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 447/923] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:35 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:36.766380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:36.766986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:36.773706 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:36.774202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:36.774644 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:36.775356 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:36.775820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:36.776252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:36.942633 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:36.947391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:36.953643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:36.955549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:36.956995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8b590c9d-152c-4cfc-9ae5-b6cd556958dc tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.194570 Sep 28 08:48:36.957858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 477/924] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:36 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:48:37.983184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:37.983796 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:37.990839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:37.991375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:37.991850 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:37.992516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:37.992977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:37.993428 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:38.135233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:38.143266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:38.144726 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:38.145954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a32bc82f-5030-476b-ae61-a142346c586c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.166699 Sep 28 08:48:38.146507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 448/925] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:37 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:39.171926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:39.172851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:39.183513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:39.184015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:39.184452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:39.185178 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:39.185635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:39.186056 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:39.318292 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:39.326355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:39.327811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:39.328971 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fc6380c8-0a33-4350-8e22-0f03fca7e2ac tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.161022 Sep 28 08:48:39.329557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 478/926] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:39 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:40.355118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:40.355733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:40.361760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:40.362248 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:40.362691 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:40.363392 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:40.363857 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:40.364282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:40.511269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:40.519827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:40.521886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:40.523064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8c41851d-dec1-425a-b513-d5d475264c55 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.171813 Sep 28 08:48:40.523808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 449/927] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:40 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:41.549489 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:41.550109 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:41.557165 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:41.557658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:41.558098 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:41.558800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:41.559255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:41.559680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:41.699248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:41.707442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:41.709518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:41.710694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b92a5109-0e4a-4922-b3a5-2b0784a5239e tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.165399 Sep 28 08:48:41.711253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 479/928] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:41 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:42.736284 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:42.736909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:42.743944 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:42.744421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:42.745071 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:42.745772 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:42.746224 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:42.746645 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:42.941278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:42.953366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:42.955152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:42.956916 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f9cd170a-1987-4658-8b98-1259cddf3536 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.224598 Sep 28 08:48:42.970999 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 450/929] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:42 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:43.484513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:43.487007 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:43.493714 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:43.494203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:43.494643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:43.495344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:43.495796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:43.496223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:43.529814 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-231f786e-c9f9-4cce-8116-36c8818d0db5 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049077 Sep 28 08:48:43.530602 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 480/930] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:48:43 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:48:43.542505 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:43.543000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:43.549564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:43.550055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:43.550497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:43.551252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:43.551713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:43.552141 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:43.583647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6cf6e71d-dacb-42d4-b463-d1b2f2b82fe3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/c3e6ae1c-ab4a-4bd1-8a6f-2192ed198549" status: 200 len: 194 microversion: 2.1 time: 0.043203 Sep 28 08:48:43.583647 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 451/931] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 08:48:43 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/c3e6ae1c-ab4a-4bd1-8a6f-2192ed198549 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:48:43.987135 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:43.987797 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:43.994911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:43.995400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:43.995837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:43.996543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:43.996989 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:43.997437 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:44.143353 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:44.151514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:44.152947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:44.154113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a4a42932-6714-4175-8710-62d157a48680 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.170931 Sep 28 08:48:44.154669 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 481/932] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:43 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:44.945060 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "601eba81-6d09-4127-95f0-6ec3024e40e3"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:48:44.947523 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:44.954027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:44.954709 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:44.955156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:44.956051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:44.956510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:44.956959 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:45.179058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:45.179674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:45.186184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:45.186691 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:45.187131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:45.187835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:45.188295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:45.188717 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:45.222914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b19f0293-8aac-4f25-8cb8-f96a35c67e15 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "POST /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281606 Sep 28 08:48:45.223572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 452/933] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:48:44 2022] POST /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:48:45.327781 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:45.336590 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:45.338070 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:45.339237 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-03ee41e9-0c34-45f1-b0ed-ea8b97c18284 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.164089 Sep 28 08:48:45.339788 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 482/934] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:45 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 28 08:48:46.365268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:46.365977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:46.372790 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:46.373320 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:46.373763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:46.374456 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:46.374914 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:46.375350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:46.390533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:48:46.511358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:46.519677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:46.521182 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:46.522371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8faed948-c540-440e-868b-cb0c282eb8c4 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.161989 Sep 28 08:48:46.522934 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 453/935] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:46 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:47.548332 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:47.548948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:47.555979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:47.556466 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:47.556903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:47.557651 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:47.558103 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:47.558658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:47.688478 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-98ba5af3-b16c-4572-92b1-6fcdda383e28 req-7d56a5f9-c291-46ad-9e1b-d2dcd5a369f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01e6e1b-84cf-44b2-85ec-dba5603c76ae", "name": "network-vif-plugged", "status": "completed", "tag": "4d6b9373-73e3-4bd1-aca0-9a1bba180a33"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:48:47.692129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:47.699114 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-98ba5af3-b16c-4572-92b1-6fcdda383e28 req-7d56a5f9-c291-46ad-9e1b-d2dcd5a369f1 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:47.699834 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-98ba5af3-b16c-4572-92b1-6fcdda383e28 req-7d56a5f9-c291-46ad-9e1b-d2dcd5a369f1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:47.700449 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-98ba5af3-b16c-4572-92b1-6fcdda383e28 req-7d56a5f9-c291-46ad-9e1b-d2dcd5a369f1 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:47.703063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:47.704605 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:47.705904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-47915888-d58b-41bb-beef-a49e927d21e8 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.161845 Sep 28 08:48:47.706551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 483/936] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:47 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:47.714415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-98ba5af3-b16c-4572-92b1-6fcdda383e28 req-7d56a5f9-c291-46ad-9e1b-d2dcd5a369f1 service nova] Creating event network-vif-plugged:4d6b9373-73e3-4bd1-aca0-9a1bba180a33 for instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae on hv-cinder-84456 Sep 28 08:48:47.724149 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-98ba5af3-b16c-4572-92b1-6fcdda383e28 req-7d56a5f9-c291-46ad-9e1b-d2dcd5a369f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038522 Sep 28 08:48:47.725233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 454/937] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:48:48.739074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:48.739682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:48.746120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:48.746596 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:48.747022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:48.747712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:48.748156 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:48.748573 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:48.877196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:48.885847 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:48.887305 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:48.888462 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1d24615c-d59c-4a4e-92a3-bb574fd99337 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.153420 Sep 28 08:48:48.889018 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 484/938] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:48 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:49.914459 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:49.915100 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:49.921212 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:49.921699 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:49.922545 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:49.923759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:49.924227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:49.924658 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:50.058269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:50.066508 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:50.068045 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:50.069234 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b94df621-eefe-4d45-9e46-c1c305bd99f2 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1730 microversion: 2.20 time: 0.159640 Sep 28 08:48:50.069806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 455/939] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:49 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:51.095002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:51.095540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:51.101966 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:51.102452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:51.102907 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:51.103592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:51.104041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:51.104556 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:51.378955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:51.387464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:51.388904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:51.390090 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ec939be5-5b85-4212-ae75-db01d229cde1 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1717 microversion: 2.20 time: 0.299089 Sep 28 08:48:51.390653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 485/940] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:48:51 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1717 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:48:52.773824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:52.776038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:52.782412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:52.782841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:52.783284 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:52.784024 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:52.784484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:52.784911 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:52.816092 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-97ce7d1e-d57f-4154-bc34-ba4e468e9d63 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046869 Sep 28 08:48:52.816677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 456/941] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:48:52 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:48:52.955064 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:52.955752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:52.965266 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:52.965887 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:52.966373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:52.967067 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:52.967522 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:52.967953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:53.000520 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a31c2dd6-5e37-43a7-bce4-b8ab20094ea7 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/c3e6ae1c-ab4a-4bd1-8a6f-2192ed198549" status: 200 len: 194 microversion: 2.1 time: 0.049588 Sep 28 08:48:53.001621 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 486/942] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 08:48:52 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/c3e6ae1c-ab4a-4bd1-8a6f-2192ed198549 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:48:53.012650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:53.013352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:53.019416 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:53.019942 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:53.020381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:53.021080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:53.021571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:53.022001 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:53.101702 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lazy-loading 'services' on Instance uuid 49faa65a-11f3-4287-b392-09d1966a700e {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:48:53.172873 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-99943baa-56ef-41ea-841d-fe48c50f8324 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/c3e6ae1c-ab4a-4bd1-8a6f-2192ed198549" status: 202 len: 0 microversion: 2.1 time: 0.163650 Sep 28 08:48:53.173497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 457/943] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:48:53 2022] DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/c3e6ae1c-ab4a-4bd1-8a6f-2192ed198549 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 28 08:48:55.354281 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:55.354812 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:55.361519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:55.362007 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:55.362439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:55.363127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:55.363599 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:55.364023 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:55.391949 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fb7ba309-58c8-4506-a266-e0b84ce98844 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/601eba81-6d09-4127-95f0-6ec3024e40e3" status: 200 len: 194 microversion: 2.1 time: 0.041630 Sep 28 08:48:55.392509 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 487/944] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Sep 28 08:48:55 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/601eba81-6d09-4127-95f0-6ec3024e40e3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:48:55.404912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:55.405550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:55.412352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:55.412829 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:55.413289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:55.413972 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:55.414419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:55.414837 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:55.506023 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lazy-loading 'services' on Instance uuid 49faa65a-11f3-4287-b392-09d1966a700e {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:48:55.581413 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-63264f48-afcb-4ff7-a754-a0f9277b973b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/601eba81-6d09-4127-95f0-6ec3024e40e3" status: 202 len: 0 microversion: 2.1 time: 0.181228 Sep 28 08:48:55.583166 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 458/945] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:48:55 2022] DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments/601eba81-6d09-4127-95f0-6ec3024e40e3 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:48:56.759779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:56.762376 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:56.768267 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:56.768753 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:56.769237 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:56.770428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:56.770882 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:56.771310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:56.800416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-116a6490-6e4b-4179-be7a-f176bd91013b tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044600 Sep 28 08:48:56.800968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 488/946] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:48:56 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:48:56.917948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:56.920560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:56.927020 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:56.927507 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:56.927939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:56.928620 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:56.929067 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:56.929506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:56.958983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0a2d9d14-9155-44ee-9f5d-3ca1df776d0c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045837 Sep 28 08:48:56.959550 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 459/947] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:48:56 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:48:57.023146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:57.023636 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:57.029486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:57.029963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:57.030393 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:57.031070 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:57.031516 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:57.031932 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:57.056783 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:48:57.137940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-05502b2d-5b5f-4582-82f8-55c6bca3b87c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 204 len: 0 microversion: 2.1 time: 0.118736 Sep 28 08:48:57.138812 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 489/948] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:48:57 2022] DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:48:57.147863 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:57.148471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:57.154613 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:57.155094 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:57.155525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:57.156219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:57.156662 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:57.157082 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:57.292110 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:57.300064 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-815327a4-c7d4-4906-80b7-819e1cd63abe tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1674 microversion: 2.1 time: 0.156689 Sep 28 08:48:57.300619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 460/949] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:57 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:48:58.324214 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:58.324904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:58.331257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:58.331756 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:58.332172 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:58.332856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:58.333335 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:58.333759 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:58.464102 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:58.471959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f21533b0-00b9-4582-8e16-45f5f49a448f tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1674 microversion: 2.1 time: 0.151949 Sep 28 08:48:58.472528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 490/950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:58 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:48:59.495423 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:48:59.496664 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:48:59.503033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:59.503523 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:59.504442 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:59.505164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:48:59.505635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:48:59.506058 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:48:59.652632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:48:59.660327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1ecbb2ab-38e4-444f-a9ed-44f3ed610278 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1674 microversion: 2.1 time: 0.169028 Sep 28 08:48:59.660900 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 461/951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:48:59 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:00.105341 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-0dc82c98-2627-43da-b0fb-5518983a9048 req-0ea5ff89-0cd5-447e-a0f6-e775c73d9671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49faa65a-11f3-4287-b392-09d1966a700e", "name": "network-vif-deleted", "tag": "224164fb-d3cb-4731-9747-97bba286b111"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:49:00.115775 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0dc82c98-2627-43da-b0fb-5518983a9048 req-0ea5ff89-0cd5-447e-a0f6-e775c73d9671 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:00.116254 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0dc82c98-2627-43da-b0fb-5518983a9048 req-0ea5ff89-0cd5-447e-a0f6-e775c73d9671 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:00.116682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-0dc82c98-2627-43da-b0fb-5518983a9048 req-0ea5ff89-0cd5-447e-a0f6-e775c73d9671 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:00.127976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-0dc82c98-2627-43da-b0fb-5518983a9048 req-0ea5ff89-0cd5-447e-a0f6-e775c73d9671 service nova] Creating event network-vif-deleted:224164fb-d3cb-4731-9747-97bba286b111 for instance 49faa65a-11f3-4287-b392-09d1966a700e on hv-cinder-84456 Sep 28 08:49:00.134138 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-0dc82c98-2627-43da-b0fb-5518983a9048 req-0ea5ff89-0cd5-447e-a0f6-e775c73d9671 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032475 Sep 28 08:49:00.134741 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 491/952] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:00.684538 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:00.685360 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:00.692464 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:00.692961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:00.693431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:00.694149 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:00.694830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:00.695294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:00.730826 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:00.731321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:00.731757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:00.732214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lazy-loading 'fault' on Instance uuid 49faa65a-11f3-4287-b392-09d1966a700e {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:49:00.774851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0fcdeafae645a582afcee3dde79ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e65d28e5664025978902943452f338', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:49:00.784183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6eaf4acf-bf86-48c0-8ba6-856a540877ef tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 200 len: 1328 microversion: 2.1 time: 0.103701 Sep 28 08:49:00.785369 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 462/953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:00 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 1328 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:01.809997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:01.810616 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:01.817339 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:01.817826 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:01.818269 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:01.818959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:01.819410 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:01.819833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:01.833642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] HTTP exception thrown: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Request method failure captured: Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e HTTP/1.1 Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf1VSsxEnsfrthzWppIwFlCFtRqli5d887B_qj1Ilcx_XpV2IEWfxzCqd7Dluw-18pFkmes-Eyal00q6fqxz8TazrRiRn7jqibNZ4bjq109l0yYLyMq_RHUCrb6THULUDv5QOvw7AvIBOewPzhjRJHWjukmN2RGjct_uW4iLHE8XE8 Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:01.835277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3e65d28e5664025978902943452f338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3e65d28e5664025978902943452f338", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: fe0fcdeafae645a582afcee3dde79ebc Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:01.836905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '49faa65a-11f3-4287-b392-09d1966a700e'} Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:01.838613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:01.840163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:01.841557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Returning 404 to user: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:01.841557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0b7ad9e5-4620-43a7-88fa-0859969baef9 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 404 len: 111 microversion: 2.1 time: 0.031585 Sep 28 08:49:01.841557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 492/954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:01 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:01.845642 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-eef855fc-7f4a-4261-ae64-724d626016f3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '.version_select at 0x7f984fcc5280>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:01.864367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-eef855fc-7f4a-4261-ae64-724d626016f3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917652473" status: 202 len: 0 microversion: 2.1 time: 0.022507 Sep 28 08:49:01.864919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 463/955] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 08:49:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1917652473 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:49:01.898368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:01.898854 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:01.900810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:01.907053 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:01.907681 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:01.908170 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:01.908946 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:01.909439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:01.909884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:01.935397 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-844358d4-d9a8-48ee-8ae4-46c7d9964f35 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/ips" status: 200 len: 149 microversion: 2.1 time: 0.041518 Sep 28 08:49:01.935961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 493/956] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:49:01 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:03.301081 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "269c668f-8ddb-4b93-99b5-1b3ee63b17ed"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:49:03.303556 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:03.306209 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:03.312529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:03.313046 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:03.314016 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:03.314807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:03.315327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:03.315865 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:03.597227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-513fbe70-1097-4330-a5ca-48bad756dc00 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "POST /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301387 Sep 28 08:49:03.597839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 464/957] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:49:03 2022] POST /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:04.797784 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:04.798289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:04.804723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:04.805253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:04.805729 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:04.806426 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:04.806885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:04.807314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:04.820968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] HTTP exception thrown: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Request method failure captured: Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e HTTP/1.1 Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf1VSsxEnsfrthzWppIwFlCFtRqli5d887B_qj1Ilcx_XpV2IEWfxzCqd7Dluw-18pFkmes-Eyal00q6fqxz8TazrRiRn7jqibNZ4bjq109l0yYLyMq_RHUCrb6THULUDv5QOvw7AvIBOewPzhjRJHWjukmN2RGjct_uW4iLHE8XE8 Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:04.822589 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3e65d28e5664025978902943452f338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3e65d28e5664025978902943452f338", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: fe0fcdeafae645a582afcee3dde79ebc Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.824058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '49faa65a-11f3-4287-b392-09d1966a700e'} Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:04.824969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.826424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.828084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Returning 404 to user: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:04.828084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4e6180b7-df68-4ddb-be4f-80f985ad830c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 404 len: 111 microversion: 2.1 time: 0.030288 Sep 28 08:49:04.828084 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 494/958] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:49:04 2022] DELETE /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:04.834104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:04.834811 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: 49faa65a-11f3-4287-b392-09d1966a700e] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:04.840909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:04.841493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:04.841936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:04.842634 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:04.843089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:04.843515 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:04.856608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] HTTP exception thrown: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Request method failure captured: Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e HTTP/1.1 Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf1VSsxEnsfrthzWppIwFlCFtRqli5d887B_qj1Ilcx_XpV2IEWfxzCqd7Dluw-18pFkmes-Eyal00q6fqxz8TazrRiRn7jqibNZ4bjq109l0yYLyMq_RHUCrb6THULUDv5QOvw7AvIBOewPzhjRJHWjukmN2RGjct_uW4iLHE8XE8 Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:04.858268 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3e65d28e5664025978902943452f338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3e65d28e5664025978902943452f338", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: fe0fcdeafae645a582afcee3dde79ebc Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.859842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '49faa65a-11f3-4287-b392-09d1966a700e'} Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:04.860751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. Sep 28 08:49:04.862334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:04.863617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Returning 404 to user: Instance 49faa65a-11f3-4287-b392-09d1966a700e could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:04.863617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f1d98a1c-c226-4790-896c-f3040265dae3 tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e" status: 404 len: 111 microversion: 2.1 time: 0.030866 Sep 28 08:49:04.863617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 465/959] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:04 2022] GET /compute/v2.1/servers/49faa65a-11f3-4287-b392-09d1966a700e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:05.997509 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:05.998022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:06.004986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:06.005501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:06.005929 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:06.006683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:06.007077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:06.007495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:06.011389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:06.022143 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] HTTP exception thrown: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Request method failure captured: Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 HTTP/1.1 Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf1VSsxEnsfrthzWppIwFlCFtRqli5d887B_qj1Ilcx_XpV2IEWfxzCqd7Dluw-18pFkmes-Eyal00q6fqxz8TazrRiRn7jqibNZ4bjq109l0yYLyMq_RHUCrb6THULUDv5QOvw7AvIBOewPzhjRJHWjukmN2RGjct_uW4iLHE8XE8 Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:06.023787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3e65d28e5664025978902943452f338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3e65d28e5664025978902943452f338", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: fe0fcdeafae645a582afcee3dde79ebc Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.025443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'bdf04325-2791-450a-8f0c-7ab39f891ec4'} Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:06.026350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.027862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.029585 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Returning 404 to user: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:06.029585 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d1dff252-d002-4c73-913e-95144feabf4c tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 404 len: 111 microversion: 2.1 time: 0.031825 Sep 28 08:49:06.029585 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 495/960] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:49:05 2022] DELETE /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:06.033448 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:06.034058 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] [instance: bdf04325-2791-450a-8f0c-7ab39f891ec4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:06.040760 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:06.041269 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:06.041703 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:06.042396 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:06.042848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:06.043270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:06.057322 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] HTTP exception thrown: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Request method failure captured: Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 HTTP/1.1 Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf1VSsxEnsfrthzWppIwFlCFtRqli5d887B_qj1Ilcx_XpV2IEWfxzCqd7Dluw-18pFkmes-Eyal00q6fqxz8TazrRiRn7jqibNZ4bjq109l0yYLyMq_RHUCrb6THULUDv5QOvw7AvIBOewPzhjRJHWjukmN2RGjct_uW4iLHE8XE8 Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:06.058836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d3e65d28e5664025978902943452f338"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d3e65d28e5664025978902943452f338"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d3e65d28e5664025978902943452f338", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: d3e65d28e5664025978902943452f338 Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1818307497 Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: fe0fcdeafae645a582afcee3dde79ebc Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeTestJSON-1818307497-project Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.060363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'bdf04325-2791-450a-8f0c-7ab39f891ec4'} Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:06.061252 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. Sep 28 08:49:06.062420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:06.063470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] Returning 404 to user: Instance bdf04325-2791-450a-8f0c-7ab39f891ec4 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:06.063470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e0a39628-06f5-4c52-abfb-26bf44f2933e tempest-AttachVolumeTestJSON-1818307497 tempest-AttachVolumeTestJSON-1818307497-project] 10.222.0.52 "GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4" status: 404 len: 111 microversion: 2.1 time: 0.030537 Sep 28 08:49:06.063470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 466/961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:06 2022] GET /compute/v2.1/servers/bdf04325-2791-450a-8f0c-7ab39f891ec4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:11.249770 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:11.250373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:11.259170 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:11.259689 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:11.260122 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:11.260816 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:11.261290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:11.261710 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:11.350276 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lazy-loading 'services' on Instance uuid ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:49:11.423493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0d167afa-4072-4442-84f2-32dd75ea6064 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments/269c668f-8ddb-4b93-99b5-1b3ee63b17ed" status: 202 len: 0 microversion: 2.1 time: 0.178046 Sep 28 08:49:11.424417 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 496/962] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:49:11 2022] DELETE /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments/269c668f-8ddb-4b93-99b5-1b3ee63b17ed => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:49:11.433605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:11.435925 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:11.442595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:11.443081 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:11.443516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:11.444223 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:11.444683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:11.445104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:11.475651 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4489879a-b613-4cbb-9250-e40e16154387 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046131 Sep 28 08:49:11.476217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 467/963] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:49:11 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:11.919532 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ceed3e7c-583f-40cb-8088-8d8963ed4f62 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fbe8d30>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:11.968278 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ceed3e7c-583f-40cb-8088-8d8963ed4f62 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/bfec048d-9b1c-4fcf-8c74-e623aaddfc2a" status: 200 len: 351 microversion: 2.1 time: 0.053090 Sep 28 08:49:11.968945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 497/964] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:11 2022] GET /compute/v2.1/os-volumes/bfec048d-9b1c-4fcf-8c74-e623aaddfc2a => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:12.488938 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:12.491115 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:12.497584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:12.498084 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:12.498525 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:12.499218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:12.499676 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:12.500101 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:12.530397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fe3a188e-bae3-4d49-9670-7b8273bb4ce7 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Sep 28 08:49:12.530959 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 468/965] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:49:12 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:13.323425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f341f43b-5c39-4b79-baa3-71325ca1b2ec tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fc74310>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:13.369817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f341f43b-5c39-4b79-baa3-71325ca1b2ec tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6f585e84-6cbb-4a2f-99e9-13166408d080" status: 200 len: 351 microversion: 2.1 time: 0.050587 Sep 28 08:49:13.370719 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 498/966] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:13 2022] GET /compute/v2.1/os-volumes/6f585e84-6cbb-4a2f-99e9-13166408d080 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:13.543658 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:13.547100 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:13.553757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:13.554315 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:13.554909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:13.555869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:13.556328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:13.556761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:13.593124 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0b40f3da-da9c-4317-8f5d-98b498e02c86 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053806 Sep 28 08:49:13.594375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 469/967] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:49:13 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:49:13.666215 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:13.666912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:13.676267 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:13.676767 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:13.677239 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:13.677948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:13.678576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:13.679008 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:13.711683 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:49:13.791618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-392fd4d5-c81d-4db5-9716-d476485f5006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 204 len: 0 microversion: 2.1 time: 0.129869 Sep 28 08:49:13.792196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 499/968] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:49:13 2022] DELETE /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:49:13.800956 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:13.801588 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:13.807367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:13.807844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:13.808274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:13.808954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:13.809462 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:13.809883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:13.813792 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:13.946148 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:49:13.953824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-37cac22b-362b-4bc1-90d6-4c7c7a8782af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1680 microversion: 2.1 time: 0.156980 Sep 28 08:49:13.954510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 470/969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:13 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:14.735592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f23862b7-1335-4510-a5ce-289d1533d6f8 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fc71550>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:14.783177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f23862b7-1335-4510-a5ce-289d1533d6f8 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1c9d4f5d-a6d3-4815-a41f-37b0773187a0" status: 200 len: 351 microversion: 2.1 time: 0.051680 Sep 28 08:49:14.783753 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 500/970] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:14 2022] GET /compute/v2.1/os-volumes/1c9d4f5d-a6d3-4815-a41f-37b0773187a0 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:14.797548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1cfc6200-2fc4-4eac-8339-f1314f05dcba tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fd77ee0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:14.878840 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1cfc6200-2fc4-4eac-8339-f1314f05dcba tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085255 Sep 28 08:49:14.879403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 471/971] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Sep 28 08:49:14 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:14.893922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cd68001a-98e0-42b6-9c31-ddb0d10c4782 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fcfc820>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:14.977736 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cd68001a-98e0-42b6-9c31-ddb0d10c4782 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088052 Sep 28 08:49:14.978270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:14.979431 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 501/972] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Sep 28 08:49:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:14.979569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:14.985592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:14.986178 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:14.986808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:14.987778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:14.988234 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:14.988667 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:14.992426 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ef68a447-d895-49a3-887b-ffa06747628f tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fa41e50>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:15.076236 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ef68a447-d895-49a3-887b-ffa06747628f tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.087787 Sep 28 08:49:15.076814 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 502/973] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Sep 28 08:49:14 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:49:15.091106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-66a32ba6-3654-4f08-823a-721339e9a5e7 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fc740d0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:15.118336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:49:15.126210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-159a6c2d-6e49-4e13-930e-ebbb152e9d6d tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1680 microversion: 2.1 time: 0.151881 Sep 28 08:49:15.126792 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 472/974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:14 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:49:15.173053 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-66a32ba6-3654-4f08-823a-721339e9a5e7 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085827 Sep 28 08:49:15.173643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 503/975] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Sep 28 08:49:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:49:15.187578 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f0f90884-7e36-457e-8b05-78cdef8fe524 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fadb310>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:15.268971 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f0f90884-7e36-457e-8b05-78cdef8fe524 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084856 Sep 28 08:49:15.269569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 473/976] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Sep 28 08:49:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:15.283210 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-68fe77e1-25a8-473a-87b2-c4b8bd85ef7a tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fad4280>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:15.367696 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-68fe77e1-25a8-473a-87b2-c4b8bd85ef7a tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088169 Sep 28 08:49:15.368262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 504/977] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Sep 28 08:49:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:15.381570 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-95ccda23-f9a2-4900-bcad-129879f7e719 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fd77dc0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:15.462816 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-95ccda23-f9a2-4900-bcad-129879f7e719 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085001 Sep 28 08:49:15.463381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 474/978] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Sep 28 08:49:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:15.477374 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a039b12f-a581-42d9-89cd-625098002a01 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] Calling method '.version_select at 0x7f984fc71f70>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:15.559523 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a039b12f-a581-42d9-89cd-625098002a01 tempest-VolumesTestJSON-995059004 tempest-VolumesTestJSON-995059004-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085840 Sep 28 08:49:15.560107 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 505/979] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Sep 28 08:49:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:16.151384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:16.152159 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:16.158103 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:16.158585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:16.159673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:16.160384 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:16.160841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:16.161297 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:16.293782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:49:16.302082 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2cbcc178-41af-4375-969d-eac4719061fe tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1680 microversion: 2.1 time: 0.155042 Sep 28 08:49:16.302772 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 475/980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:16 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:16.795177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-9a905647-c933-465b-b555-289b114ebd8c req-d51877da-3d66-44a5-bba5-807bff409135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b", "name": "network-vif-deleted", "tag": "a3ad7883-60b5-4319-9508-c4abe5abf2d6"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:49:16.810400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-9a905647-c933-465b-b555-289b114ebd8c req-d51877da-3d66-44a5-bba5-807bff409135 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:16.811127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-9a905647-c933-465b-b555-289b114ebd8c req-d51877da-3d66-44a5-bba5-807bff409135 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:16.811792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-9a905647-c933-465b-b555-289b114ebd8c req-d51877da-3d66-44a5-bba5-807bff409135 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:16.825800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-9a905647-c933-465b-b555-289b114ebd8c req-d51877da-3d66-44a5-bba5-807bff409135 service nova] Creating event network-vif-deleted:a3ad7883-60b5-4319-9508-c4abe5abf2d6 for instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b on hv-cinder-84456 Sep 28 08:49:16.834614 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-9a905647-c933-465b-b555-289b114ebd8c req-d51877da-3d66-44a5-bba5-807bff409135 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042388 Sep 28 08:49:16.836117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 506/981] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:17.325224 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:17.326057 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:17.333731 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:17.334226 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:17.334671 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:17.335381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:17.335834 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:17.336470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:17.374476 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:17.374957 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:17.375385 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:17.375828 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lazy-loading 'fault' on Instance uuid ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:49:17.422203 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3b9ceb95374f1dbf356122c8ed463c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc96052a69e409498462a1e4d499910', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:49:17.432538 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-65668639-65f2-42b6-8f28-2b968815a778 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 200 len: 1332 microversion: 2.1 time: 0.111071 Sep 28 08:49:17.433409 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 476/982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:17 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:49:18.456984 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:18.457729 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:18.464272 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:18.464757 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:18.465222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:18.465918 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:18.466409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:18.466837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:18.479912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b HTTP/1.1 Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:18.481567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:18.483290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b'} Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:18.484196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:18.485727 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:18.487150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:18.487150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8751602b-99a5-468a-afd9-1c6494a38178 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 404 len: 111 microversion: 2.1 time: 0.030274 Sep 28 08:49:18.487150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 507/983] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:18 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:18.492304 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-73bcf6a7-ec90-4f20-b0eb-4ba253ae8192 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '.version_select at 0x7f984fd58280>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:18.512533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-73bcf6a7-ec90-4f20-b0eb-4ba253ae8192 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076186214" status: 202 len: 0 microversion: 2.1 time: 0.024013 Sep 28 08:49:18.513125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 477/984] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Sep 28 08:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076186214 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:49:20.408463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:20.408954 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:20.415728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:20.416211 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:20.416636 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:20.417346 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:20.417793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:20.418209 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:20.432319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b HTTP/1.1 Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:20.434094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.435414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b'} Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:20.436313 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.437865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.439751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:20.439751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fcdd1adb-26f0-491b-99df-a382ed7386f8 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 404 len: 111 microversion: 2.1 time: 0.030818 Sep 28 08:49:20.439751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 508/985] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:49:20 2022] DELETE /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:20.445786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:20.446368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:20.453023 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:20.453576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:20.454014 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:20.454794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:20.455254 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:20.455685 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:20.468679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b HTTP/1.1 Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:20.470249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.471650 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b'} Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:20.474522 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. Sep 28 08:49:20.475727 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:20.476922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:20.476922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-008766bc-57ff-4fa0-82b7-3d8128beb5b0 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b" status: 404 len: 111 microversion: 2.1 time: 0.030447 Sep 28 08:49:20.476922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 478/986] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:20 2022] GET /compute/v2.1/servers/ae27fb00-70c1-4f6c-9ab8-23a24e9ec49b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:21.621017 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:21.621542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:21.627795 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.629005 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.629370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.630057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.630504 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.630925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.644188 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 HTTP/1.1 Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:21.645764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.647338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'e6ab421e-2f19-43f0-8732-27ded4ece5d7'} Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:21.648087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.649322 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.650514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:21.650514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bc1dfc1d-aa37-4f2d-b27e-8cd5381962af tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 404 len: 111 microversion: 2.1 time: 0.029955 Sep 28 08:49:21.650514 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 509/987] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:49:21 2022] DELETE /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:21.655952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:21.656560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: e6ab421e-2f19-43f0-8732-27ded4ece5d7] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:21.662932 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.663408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.663838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.664520 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.664967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.665413 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.679680 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 HTTP/1.1 Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:21.681277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.683929 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'e6ab421e-2f19-43f0-8732-27ded4ece5d7'} Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:21.685426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. Sep 28 08:49:21.687839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.689928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance e6ab421e-2f19-43f0-8732-27ded4ece5d7 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:21.689928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8a63990e-125b-401d-8f0f-f4e3245a99a1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7" status: 404 len: 111 microversion: 2.1 time: 0.030556 Sep 28 08:49:21.689928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 479/988] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:21 2022] GET /compute/v2.1/servers/e6ab421e-2f19-43f0-8732-27ded4ece5d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:21.692640 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:21.693179 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:21.699210 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.699697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.700137 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.700832 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.701323 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.701749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.715297 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee HTTP/1.1 Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:21.716837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.718433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '489154e1-8189-48c2-9b84-b7f0c34221ee'} Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:21.719391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.720992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.723355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:21.723355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c353edfd-79de-47eb-8c02-ff9fdeb347bd tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 404 len: 111 microversion: 2.1 time: 0.030093 Sep 28 08:49:21.723355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 510/989] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:49:21 2022] DELETE /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:21.727228 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:21.727844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 489154e1-8189-48c2-9b84-b7f0c34221ee] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:21.733710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.734194 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.734637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.735328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:21.735784 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:21.736216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:21.749407 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee HTTP/1.1 Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:21.750968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.752564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '489154e1-8189-48c2-9b84-b7f0c34221ee'} Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:21.753948 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. Sep 28 08:49:21.755630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:21.757029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance 489154e1-8189-48c2-9b84-b7f0c34221ee could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:21.757029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-138f4edb-9d35-4bf5-96e9-0e598276ab46 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee" status: 404 len: 111 microversion: 2.1 time: 0.028951 Sep 28 08:49:21.757029 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 480/990] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:21 2022] GET /compute/v2.1/servers/489154e1-8189-48c2-9b84-b7f0c34221ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:22.896480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:22.896975 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:22.903334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:22.903811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:22.904241 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:22.904920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:22.905389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:22.905809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:22.919277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 HTTP/1.1 Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:22.920829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.922549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '1d333fe6-3d16-47c6-9104-714c67456652'} Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:22.923445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.924687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.926048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:22.926048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1b1fcee0-9a7b-4f38-ba22-9a96f8f03006 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 404 len: 111 microversion: 2.1 time: 0.030395 Sep 28 08:49:22.926048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 511/991] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:49:22 2022] DELETE /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:22.931399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:22.932011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] [instance: 1d333fe6-3d16-47c6-9104-714c67456652] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:49:22.938894 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:22.939412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:22.939853 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:22.940557 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:49:22.941012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:49:22.941465 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:49:22.957928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] HTTP exception thrown: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Request method failure captured: Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 HTTP/1.1 Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAf56yHU37p5feNk4DwNKDHeJ6rUUzgGFNM_8strk8k82o1UtmAzSaRqCQT9u1YFxbMsljE3qEoa5eyn6ciTwOarXTyfxJpZcoLKv7WvIzGzsCObqxkaOt3uLwKaZZp3Xe4VssqIyY5nshVF92fLVUOOOaQTL4ZOxVYymPLd1Jqqz-c Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:22.959922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6bc96052a69e409498462a1e4d499910"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6bc96052a69e409498462a1e4d499910"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6bc96052a69e409498462a1e4d499910", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6bc96052a69e409498462a1e4d499910 Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422995557 Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 7e3b9ceb95374f1dbf356122c8ed463c Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeNegativeTest-422995557-project Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.961524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '1d333fe6-3d16-47c6-9104-714c67456652'} Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:22.962540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. Sep 28 08:49:22.964073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:22.965718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] Returning 404 to user: Instance 1d333fe6-3d16-47c6-9104-714c67456652 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:22.965718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-39f3cfaf-6ce2-4568-80e1-fe84a51929c1 tempest-AttachVolumeNegativeTest-422995557 tempest-AttachVolumeNegativeTest-422995557-project] 10.222.0.52 "GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652" status: 404 len: 111 microversion: 2.1 time: 0.034448 Sep 28 08:49:22.965718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 481/992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:49:22 2022] GET /compute/v2.1/servers/1d333fe6-3d16-47c6-9104-714c67456652 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:27.471279 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-86b7ff7c-db36-4e97-b5f2-461fbab5b162 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Action: 'create', calling method: .version_select at 0x7f984fc92700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1710810330"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:49:27.801391 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-86b7ff7c-db36-4e97-b5f2-461fbab5b162 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.454342 Sep 28 08:49:27.802020 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 512/993] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Sep 28 08:49:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 456 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 28 08:49:27.817739 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-56c82ee3-eb6a-46c2-bbb9-a179e73b1200 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fd1c550>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:27.869849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-56c82ee3-eb6a-46c2-bbb9-a179e73b1200 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 200 len: 345 microversion: 2.1 time: 0.058274 Sep 28 08:49:27.870617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 482/994] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:27 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:28.885171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3d2449cd-c3b1-444b-944c-e42155eee588 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fd29e50>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:28.937670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3d2449cd-c3b1-444b-944c-e42155eee588 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 200 len: 346 microversion: 2.1 time: 0.056707 Sep 28 08:49:28.938403 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 513/995] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:28 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:28.952142 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-25bf71e1-1b81-4c67-84b0-3b81481360f2 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Action: 'create', calling method: .version_select at 0x7f984fadbee0>, body: {"snapshot": {"volume_id": "cd14d2b5-1c51-4e77-a255-1c765731c763", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-347383527"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:49:29.101909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-25bf71e1-1b81-4c67-84b0-3b81481360f2 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.154095 Sep 28 08:49:29.102577 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 483/996] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Sep 28 08:49:28 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:49:29.122364 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e338d961-8a28-49a7-a7cb-245672d5fb05 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fc928b0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:29.153531 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e338d961-8a28-49a7-a7cb-245672d5fb05 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 200 len: 286 microversion: 2.1 time: 0.043484 Sep 28 08:49:29.154183 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 514/997] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:29 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:29.165539 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-811d8811-d27f-4deb-b097-e6065583dba7 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fcc5430>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:29.198042 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-811d8811-d27f-4deb-b097-e6065583dba7 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036252 Sep 28 08:49:29.198630 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 484/998] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Sep 28 08:49:29 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:29.210978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f298c228-d065-4a48-95dc-a8bc3bac816e tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fbe8790>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:29.242348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f298c228-d065-4a48-95dc-a8bc3bac816e tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 200 len: 286 microversion: 2.1 time: 0.035616 Sep 28 08:49:29.243414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 515/999] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:29 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:30.256300 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c854f2a1-118c-4a62-9e98-a1e6757980c3 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fcc53a0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:30.288663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c854f2a1-118c-4a62-9e98-a1e6757980c3 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 200 len: 286 microversion: 2.1 time: 0.036489 Sep 28 08:49:30.289420 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 485/1000] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:30 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:31.301911 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1439d24a-f3ab-48b7-9e57-6af1bdaec748 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fc719d0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:31.333772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1439d24a-f3ab-48b7-9e57-6af1bdaec748 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 200 len: 286 microversion: 2.1 time: 0.036613 Sep 28 08:49:31.334433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 516/1001] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:31 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:32.347403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7d7f8d83-3f8a-4209-8013-1f742fd4ae0a tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fd1cdc0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:32.376926 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7d7f8d83-3f8a-4209-8013-1f742fd4ae0a tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 200 len: 286 microversion: 2.1 time: 0.033945 Sep 28 08:49:32.377518 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 486/1002] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:32 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:33.387752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:33.388535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:33.393006 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c6050ee1-a3c9-4ded-b6e1-13b09b6187a4 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fa6f9d0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:33.426760 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c6050ee1-a3c9-4ded-b6e1-13b09b6187a4 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 200 len: 287 microversion: 2.1 time: 0.040275 Sep 28 08:49:33.427387 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 517/1003] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:33 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:33.435501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:33.436285 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=33 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:49:33.441837 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-66f632d5-0c92-4523-98c1-10be11b47b88 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fd1cca0>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:33.498989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-66f632d5-0c92-4523-98c1-10be11b47b88 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 202 len: 0 microversion: 2.1 time: 0.064098 Sep 28 08:49:33.499566 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 487/1004] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Sep 28 08:49:33 2022] DELETE /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:49:33.507731 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-701e9512-1f28-4270-bae4-54a72b9387c9 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fc92430>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:33.538420 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-701e9512-1f28-4270-bae4-54a72b9387c9 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 200 len: 286 microversion: 2.1 time: 0.034414 Sep 28 08:49:33.538990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 518/1005] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:33 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:34.552638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b9ee93bf-e1bf-459a-9379-feb2328b3b10 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fcc5e50>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:34.577788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-b9ee93bf-e1bf-459a-9379-feb2328b3b10 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] HTTP exception thrown: Snapshot 0522adbd-0287-4000-b3f2-68e2b6dadc36 could not be found. Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b9ee93bf-e1bf-459a-9379-feb2328b3b10 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Request method failure captured: Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 HTTP/1.1 Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAqXIuxUSF47STlG21qrmloZnDPGPhGPOgTa_cwQFFBi-4IE8RSOfo6FBgP7d7uC4Bf3btjl-Vu7WitG8ciw4GzYDckOtKd3YB0MKWQbYxBEn08mA6QkYtzfB5o5Vt1NBRvZCEUnKBljyXAwqivF7yINahfi_am-1WynTkFCrc3_pME Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:34.580883 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c7b3e2580f947b981190ee592fb5525", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 077aa647333e4e6e8350dec490cecb72 Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Snapshot 0522adbd-0287-4000-b3f2-68e2b6dadc36 could not be found. Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '0522adbd-0287-4000-b3f2-68e2b6dadc36'} Sep 28 08:49:34.582571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0522adbd-0287-4000-b3f2-68e2b6dadc36 could not be found. (HTTP 404) (Request-ID: req-32ad6eea-7275-4b59-8a33-9eb720761008) Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:34.583422 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:49:34.584831 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0522adbd-0287-4000-b3f2-68e2b6dadc36 could not be found. Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 28 08:49:34.586256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0522adbd-0287-4000-b3f2-68e2b6dadc36 could not be found. Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0522adbd-0287-4000-b3f2-68e2b6dadc36 could not be found. Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b9ee93bf-e1bf-459a-9379-feb2328b3b10 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Returning 404 to user: Snapshot 0522adbd-0287-4000-b3f2-68e2b6dadc36 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:34.587682 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b9ee93bf-e1bf-459a-9379-feb2328b3b10 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36" status: 404 len: 111 microversion: 2.1 time: 0.035180 Sep 28 08:49:34.588625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 488/1006] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Sep 28 08:49:34 2022] GET /compute/v2.1/os-snapshots/0522adbd-0287-4000-b3f2-68e2b6dadc36 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:34.591894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-91cc4d38-c895-4160-b836-ba32adc2d448 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fd29b80>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:34.655148 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-91cc4d38-c895-4160-b836-ba32adc2d448 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 202 len: 0 microversion: 2.1 time: 0.067495 Sep 28 08:49:34.655741 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 519/1007] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:49:34 2022] DELETE /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:49:34.664293 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5861d7c3-2a34-4bc8-993e-df30990db86b tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fb51c10>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:34.712058 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5861d7c3-2a34-4bc8-993e-df30990db86b tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 200 len: 345 microversion: 2.1 time: 0.051982 Sep 28 08:49:34.712621 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 489/1008] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:34 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:35.727368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3952cf9b-7320-4246-8af7-3524bc2b0bcf tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fa6f9d0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:35.774097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3952cf9b-7320-4246-8af7-3524bc2b0bcf tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 200 len: 345 microversion: 2.1 time: 0.051090 Sep 28 08:49:35.774664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 520/1009] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:35 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:36.790769 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1e27248c-aa07-479b-af99-afc47fd64d23 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fcc5c10>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:36.840334 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1e27248c-aa07-479b-af99-afc47fd64d23 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 200 len: 345 microversion: 2.1 time: 0.053949 Sep 28 08:49:36.840888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 490/1010] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:36 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:37.856011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-25d51c1e-19fd-4cdf-8be5-fb8d3692c9d1 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fd29d30>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:37.902621 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-25d51c1e-19fd-4cdf-8be5-fb8d3692c9d1 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 200 len: 345 microversion: 2.1 time: 0.051080 Sep 28 08:49:37.903183 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 521/1011] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:37 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:49:38.917704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7e6701aa-e9bb-4e13-b110-e3bdfe8c21ec tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fbfa550>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:38.946537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-7e6701aa-e9bb-4e13-b110-e3bdfe8c21ec tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] HTTP exception thrown: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7e6701aa-e9bb-4e13-b110-e3bdfe8c21ec tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Request method failure captured: Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 HTTP/1.1 Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAqXIuxUSF47STlG21qrmloZnDPGPhGPOgTa_cwQFFBi-4IE8RSOfo6FBgP7d7uC4Bf3btjl-Vu7WitG8ciw4GzYDckOtKd3YB0MKWQbYxBEn08mA6QkYtzfB5o5Vt1NBRvZCEUnKBljyXAwqivF7yINahfi_am-1WynTkFCrc3_pME Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:38.949274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c7b3e2580f947b981190ee592fb5525", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 077aa647333e4e6e8350dec490cecb72 Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'cd14d2b5-1c51-4e77-a255-1c765731c763'} Sep 28 08:49:38.950895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. (HTTP 404) (Request-ID: req-f62b9ede-16a2-4512-bc44-ec1fcee037b7) Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:38.951933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:49:38.953438 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 08:49:38.955133 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7e6701aa-e9bb-4e13-b110-e3bdfe8c21ec tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Returning 404 to user: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7e6701aa-e9bb-4e13-b110-e3bdfe8c21ec tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 404 len: 109 microversion: 2.1 time: 0.037492 Sep 28 08:49:38.957128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 491/1012] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:38 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:38.965345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8e0312ad-32f6-46b9-9469-6ad0259b4061 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fd5e0d0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:38.993976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-8e0312ad-32f6-46b9-9469-6ad0259b4061 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] HTTP exception thrown: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8e0312ad-32f6-46b9-9469-6ad0259b4061 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Request method failure captured: Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 HTTP/1.1 Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAqXIuxUSF47STlG21qrmloZnDPGPhGPOgTa_cwQFFBi-4IE8RSOfo6FBgP7d7uC4Bf3btjl-Vu7WitG8ciw4GzYDckOtKd3YB0MKWQbYxBEn08mA6QkYtzfB5o5Vt1NBRvZCEUnKBljyXAwqivF7yINahfi_am-1WynTkFCrc3_pME Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:49:38.995916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c7b3e2580f947b981190ee592fb5525", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 077aa647333e4e6e8350dec490cecb72 Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'cd14d2b5-1c51-4e77-a255-1c765731c763'} Sep 28 08:49:38.997535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. (HTTP 404) (Request-ID: req-b5dc5492-5f4a-4cf1-b268-35622a7317ff) Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:38.998650 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 28 08:49:39.000110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 28 08:49:39.001593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8e0312ad-32f6-46b9-9469-6ad0259b4061 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Returning 404 to user: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:39.002926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8e0312ad-32f6-46b9-9469-6ad0259b4061 tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 404 len: 109 microversion: 2.1 time: 0.036308 Sep 28 08:49:39.003887 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 522/1013] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Sep 28 08:49:38 2022] DELETE /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:49:39.005856 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c77680dd-9641-4e4b-b74c-2fc924635cca tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Calling method '.version_select at 0x7f984fa81310>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:49:39.033157 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-c77680dd-9641-4e4b-b74c-2fc924635cca tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] HTTP exception thrown: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c77680dd-9641-4e4b-b74c-2fc924635cca tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Request method failure captured: Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 HTTP/1.1 Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAqXIuxUSF47STlG21qrmloZnDPGPhGPOgTa_cwQFFBi-4IE8RSOfo6FBgP7d7uC4Bf3btjl-Vu7WitG8ciw4GzYDckOtKd3YB0MKWQbYxBEn08mA6QkYtzfB5o5Vt1NBRvZCEUnKBljyXAwqivF7yINahfi_am-1WynTkFCrc3_pME Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:49:39.035144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c7b3e2580f947b981190ee592fb5525"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c7b3e2580f947b981190ee592fb5525", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 6c7b3e2580f947b981190ee592fb5525 Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1288963762 Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: 077aa647333e4e6e8350dec490cecb72 Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1288963762-project Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'cd14d2b5-1c51-4e77-a255-1c765731c763'} Sep 28 08:49:39.037351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. (HTTP 404) (Request-ID: req-ca6d4f6f-c724-4517-aab6-b08e23f89b42) Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:39.038319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 28 08:49:39.039473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 28 08:49:39.040653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c77680dd-9641-4e4b-b74c-2fc924635cca tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] Returning 404 to user: Volume cd14d2b5-1c51-4e77-a255-1c765731c763 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c77680dd-9641-4e4b-b74c-2fc924635cca tempest-VolumesSnapshotsTestJSON-1288963762 tempest-VolumesSnapshotsTestJSON-1288963762-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763" status: 404 len: 109 microversion: 2.1 time: 0.035113 Sep 28 08:49:39.042195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 492/1014] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Sep 28 08:49:39 2022] GET /compute/v2.1/os-volumes/cd14d2b5-1c51-4e77-a255-1c765731c763 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:50:10.451817 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:10.453980 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:10.461540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:10.462028 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:10.462472 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:10.463163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:10.463615 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:10.464042 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:10.493155 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-173f543c-6745-42b7-9352-b0124cfded8d tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046340 Sep 28 08:50:10.493866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 523/1015] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Sep 28 08:50:10 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:50:10.562254 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:10.562776 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:10.571125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:10.571125 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:10.571428 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:10.571945 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:10.572399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:10.573173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:10.602789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:50:10.678705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d306de7a-5327-4fca-8fc0-44e8a56d1f4b tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 204 len: 0 microversion: 2.20 time: 0.121969 Sep 28 08:50:10.679289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 493/1016] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 08:50:10 2022] DELETE /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 08:50:10.688290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:10.689058 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:10.695745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:10.696234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:10.696677 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:10.697411 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:10.697866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:10.698293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:10.831758 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:10.839835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:10.841392 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:10.842597 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-098e3e6b-77ae-449a-b3bf-4edd9f042019 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.158420 Sep 28 08:50:10.843144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 524/1017] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:10 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:50:11.868978 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:11.869719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:11.876087 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:11.880076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:11.880076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:11.880076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:11.880076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:11.880391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:12.018855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:12.027173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:12.028612 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:12.029806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-4e1e4435-1328-4bfc-8201-68f713985aee tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.165154 Sep 28 08:50:12.030353 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 494/1018] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:11 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:50:13.056508 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:13.057126 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:13.063529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:13.064012 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:13.064445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:13.065163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:13.065622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:13.066191 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:13.195147 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:13.203246 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:13.204700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:13.205891 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-0d57c4d3-c942-4135-aaf6-834baf49ed33 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.153326 Sep 28 08:50:13.206439 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 525/1019] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:13 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:50:14.230530 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:14.231127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:14.237576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:14.238665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:14.239110 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:14.239805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:14.240267 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:14.240694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:14.372009 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:14.380221 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:14.381750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:14.382902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ad0b1bf2-ec2c-469c-bee1-bcab34f1b00c tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.156378 Sep 28 08:50:14.383451 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 495/1020] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:14 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:50:15.410464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:15.411349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:15.417513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:15.418056 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:15.418489 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:15.419221 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:15.419674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:15.420102 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:15.554860 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:15.565586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:15.567479 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:15.568621 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3b1a263d-ed55-49ec-8cfb-53dfca41b5b3 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1723 microversion: 2.20 time: 0.164633 Sep 28 08:50:15.569490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 526/1021] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:15 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:50:16.600733 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:16.601369 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:16.607771 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:16.608172 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:16.608601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:16.609319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:16.609766 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:16.610207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:16.674675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:16.683926 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:16.685479 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b0cbf49cfca74838bee4c8162dfe27ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c067f1df3c7f47299bc2db03d904d156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:16.686677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bf9469fc-ae54-4a5d-b0ac-1e05d6d93581 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 200 len: 1655 microversion: 2.20 time: 0.094785 Sep 28 08:50:16.687778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 496/1022] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:16 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 28 08:50:17.063250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-57e54f7b-0c24-418c-b089-1b5da4c9b53e req-1a316973-ea95-45f1-a241-e414b2d07afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01e6e1b-84cf-44b2-85ec-dba5603c76ae", "name": "network-vif-deleted", "tag": "4d6b9373-73e3-4bd1-aca0-9a1bba180a33"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:50:17.076918 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-57e54f7b-0c24-418c-b089-1b5da4c9b53e req-1a316973-ea95-45f1-a241-e414b2d07afd service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:17.077419 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-57e54f7b-0c24-418c-b089-1b5da4c9b53e req-1a316973-ea95-45f1-a241-e414b2d07afd service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:17.078091 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-57e54f7b-0c24-418c-b089-1b5da4c9b53e req-1a316973-ea95-45f1-a241-e414b2d07afd service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:17.090968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-57e54f7b-0c24-418c-b089-1b5da4c9b53e req-1a316973-ea95-45f1-a241-e414b2d07afd service nova] Creating event network-vif-deleted:4d6b9373-73e3-4bd1-aca0-9a1bba180a33 for instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae on hv-cinder-84456 Sep 28 08:50:17.097787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-57e54f7b-0c24-418c-b089-1b5da4c9b53e req-1a316973-ea95-45f1-a241-e414b2d07afd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291951 Sep 28 08:50:17.098961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 527/1023] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:50:17.717391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:17.718417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:17.727211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:17.731327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:17.731775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:17.732501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:17.733080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:17.733494 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:17.749807 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] HTTP exception thrown: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Request method failure captured: Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae HTTP/1.1 Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAhxSddb8QjztshJzvf4vr94QsmkUjOKtWhUzn1rEe7T7xBEpQOyWVyO3xKpcxxgTH8an0rI4nsplzwSA8BPHRgh9QxiFzACiqdxvJzYwAOfczz3YuP6Vix50hDHgHNzgafbJMPmpcPAJjf887o2blb_o2m-jDDNR4ZHQNEB75rpWIY Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:50:17.751576 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c067f1df3c7f47299bc2db03d904d156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: b0cbf49cfca74838bee4c8162dfe27ef Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:17.753415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'f01e6e1b-84cf-44b2-85ec-dba5603c76ae'} Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:50:17.757814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:17.759446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:17.760851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Returning 404 to user: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:50:17.760851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a8b2a05a-1268-416c-86e4-62cc9af48cea tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 404 len: 111 microversion: 2.20 time: 0.041026 Sep 28 08:50:17.760851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 497/1024] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:17 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:50:17.762730 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-649a5e53-c469-49ff-9c30-9d5e7c40ea47 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '.version_select at 0x7f98549468b0>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:17.785371 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-649a5e53-c469-49ff-9c30-9d5e7c40ea47 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-294159261" status: 204 len: 0 microversion: 2.20 time: 0.026116 Sep 28 08:50:17.785957 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 528/1025] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Sep 28 08:50:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-294159261 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 28 08:50:23.064397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:23.064898 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:23.071940 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:23.072720 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:23.073504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:23.074386 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:23.075020 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:23.075551 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:23.090469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] HTTP exception thrown: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Request method failure captured: Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: DELETE /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae HTTP/1.1 Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAhxSddb8QjztshJzvf4vr94QsmkUjOKtWhUzn1rEe7T7xBEpQOyWVyO3xKpcxxgTH8an0rI4nsplzwSA8BPHRgh9QxiFzACiqdxvJzYwAOfczz3YuP6Vix50hDHgHNzgafbJMPmpcPAJjf887o2blb_o2m-jDDNR4ZHQNEB75rpWIY Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:50:23.092059 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c067f1df3c7f47299bc2db03d904d156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: b0cbf49cfca74838bee4c8162dfe27ef Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.093591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'f01e6e1b-84cf-44b2-85ec-dba5603c76ae'} Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:50:23.098250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.099503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.102048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Returning 404 to user: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:50:23.102048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2399d268-ad18-4416-b616-9293cfc1d3f6 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 404 len: 111 microversion: 2.20 time: 0.032963 Sep 28 08:50:23.102048 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 498/1026] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 08:50:23 2022] DELETE /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:50:23.103062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:23.103912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: f01e6e1b-84cf-44b2-85ec-dba5603c76ae] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:23.111116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:23.111302 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:23.111716 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:23.112481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:23.112970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:23.113476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:23.127563 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] HTTP exception thrown: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Request method failure captured: Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae HTTP/1.1 Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAhxSddb8QjztshJzvf4vr94QsmkUjOKtWhUzn1rEe7T7xBEpQOyWVyO3xKpcxxgTH8an0rI4nsplzwSA8BPHRgh9QxiFzACiqdxvJzYwAOfczz3YuP6Vix50hDHgHNzgafbJMPmpcPAJjf887o2blb_o2m-jDDNR4ZHQNEB75rpWIY Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:50:23.129337 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c067f1df3c7f47299bc2db03d904d156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: b0cbf49cfca74838bee4c8162dfe27ef Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.130774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'f01e6e1b-84cf-44b2-85ec-dba5603c76ae'} Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:50:23.131519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. Sep 28 08:50:23.132713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:23.134747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Returning 404 to user: Instance f01e6e1b-84cf-44b2-85ec-dba5603c76ae could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:50:23.134747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-83846d5b-24d9-4160-851f-767e45934cd7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae" status: 404 len: 111 microversion: 2.20 time: 0.031811 Sep 28 08:50:23.134747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 529/1027] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:23 2022] GET /compute/v2.1/servers/f01e6e1b-84cf-44b2-85ec-dba5603c76ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:50:24.347848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:24.348528 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:24.356823 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:24.357982 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:24.358756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:24.359836 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:24.360476 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:24.361066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:24.376718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] HTTP exception thrown: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Request method failure captured: Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: DELETE /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 HTTP/1.1 Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAhxSddb8QjztshJzvf4vr94QsmkUjOKtWhUzn1rEe7T7xBEpQOyWVyO3xKpcxxgTH8an0rI4nsplzwSA8BPHRgh9QxiFzACiqdxvJzYwAOfczz3YuP6Vix50hDHgHNzgafbJMPmpcPAJjf887o2blb_o2m-jDDNR4ZHQNEB75rpWIY Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:50:24.378461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c067f1df3c7f47299bc2db03d904d156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: b0cbf49cfca74838bee4c8162dfe27ef Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.380214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4'} Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:50:24.381070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.382619 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.384154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Returning 404 to user: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:50:24.384154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1b3f45a7-1e12-4789-ba52-afa28720facb tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 404 len: 111 microversion: 2.20 time: 0.037383 Sep 28 08:50:24.384154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 499/1028] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Sep 28 08:50:24 2022] DELETE /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 28 08:50:24.388767 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:24.389416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] [instance: 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:24.396936 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:24.397476 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:24.397913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:24.398627 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:24.399089 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:24.400046 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:24.422399 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] HTTP exception thrown: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Request method failure captured: Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 HTTP/1.1 Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAhxSddb8QjztshJzvf4vr94QsmkUjOKtWhUzn1rEe7T7xBEpQOyWVyO3xKpcxxgTH8an0rI4nsplzwSA8BPHRgh9QxiFzACiqdxvJzYwAOfczz3YuP6Vix50hDHgHNzgafbJMPmpcPAJjf887o2blb_o2m-jDDNR4ZHQNEB75rpWIY Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Openstack-Nova-Api-Version: 2.20 Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:50:24.425050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c067f1df3c7f47299bc2db03d904d156"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c067f1df3c7f47299bc2db03d904d156", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: c067f1df3c7f47299bc2db03d904d156 Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-89505712 Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: b0cbf49cfca74838bee4c8162dfe27ef Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-89505712-project Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.426776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4'} Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:50:24.427618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. Sep 28 08:50:24.428996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:50:24.430395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] Returning 404 to user: Instance 4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:50:24.430395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ad19d22c-ae68-4368-8836-331b94c2adf7 tempest-AttachVolumeShelveTestJSON-89505712 tempest-AttachVolumeShelveTestJSON-89505712-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4" status: 404 len: 111 microversion: 2.20 time: 0.041824 Sep 28 08:50:24.431063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 530/1029] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Sep 28 08:50:24 2022] GET /compute/v2.1/servers/4ea8e7bb-18d0-4ca5-a499-01b9b7351dd4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 28 08:50:30.324803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f5161392-0bdc-4df0-b197-92a6c0565fc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Action: 'create', calling method: .version_select at 0x7f984fdf49d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-215678673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGF318/I/eadxTfwenLvxYrCYO0QtRMS5EPBsvNgR7wI5C7FXjT830KaB3jcSQGEzimgWw7NhBpZkOqx3CRMwSFv9TIQOJadKVSqHppCgo8lsEU1VFr/1nlUIEIAyq+Gg=="}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:50:30.351104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-f5161392-0bdc-4df0-b197-92a6c0565fc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for project ba777b9726e944a881c0953e605f7477. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:50:30.355732 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-f5161392-0bdc-4df0-b197-92a6c0565fc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for user e4ecba03d9254112b343f36ade20754f and project ba777b9726e944a881c0953e605f7477. Resources: {'key_pairs'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:50:30.389041 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f5161392-0bdc-4df0-b197-92a6c0565fc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.284321 Sep 28 08:50:30.390275 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 500/1030] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:50:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:50:55.630783 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1108589643", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-215678673", "security_groups": [{"name": "tempest-secgroup-smoke-1169161800"}], "block_device_mapping_v2": [{"uuid": "2d211cf0-3f3b-4ac8-9ba5-b3ce9dd74bd1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "411ef26c-758f-4425-9392-e141db9ca352"}]}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:50:55.641886 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:55.642430 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=30 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:55.645528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 08:50:55.645742 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Wed Sep 28 08:50:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! Sep 28 08:50:55.775333 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] validate_networks() for [('411ef26c-758f-4425-9392-e141db9ca352', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:50:56.358265 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:50:56.359016 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:50:56.359664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:50:56.360218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:50:56.360779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:50:56.371310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:56.371793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:56.372227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:56.372961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:56.373443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:56.373871 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:56.391367 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for project ba777b9726e944a881c0953e605f7477. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:50:56.396190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for user e4ecba03d9254112b343f36ade20754f and project ba777b9726e944a881c0953e605f7477. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:50:56.458035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:50:56.460225 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d211cf0-3f3b-4ac8-9ba5-b3ce9dd74bd1',volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:50:56.627352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b4bc5da5-4b39-4f02-a98d-6c26b1068bc9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.000815 Sep 28 08:50:56.634785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 531/1031] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:50:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:50:56.637367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:56.638753 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=4 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:56.639475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:50:56.644006 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9b69b5dd-9a15-4054-8195-2d0ca49109df tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:56.644641 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9b69b5dd-9a15-4054-8195-2d0ca49109df tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:56.724376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9b69b5dd-9a15-4054-8195-2d0ca49109df tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:56.734513 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9b69b5dd-9a15-4054-8195-2d0ca49109df tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1094 microversion: 2.1 time: 0.098192 Sep 28 08:50:56.741257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 501/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:50:56 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1094 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:50:57.760349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:57.760953 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:57.768184 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:57.768690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:57.769234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:57.769937 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:57.770401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:57.770825 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:57.850792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:57.863768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bbe85594-bafa-4fe8-a2ed-91266f3a5531 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1192 microversion: 2.1 time: 0.107938 Sep 28 08:50:57.877117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 532/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:50:57 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:50:58.887977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:50:58.888886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:50:58.898056 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:58.898553 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:58.900471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:58.901336 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:58.901815 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:58.902260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:59.073444 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:50:59.082074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5b9bc25e-c828-434b-9e6c-07ab12a27633 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1278 microversion: 2.1 time: 0.198109 Sep 28 08:50:59.082637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 502/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:50:58 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:50:59.777395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-d62876a5-c22c-481d-8046-c4d6c5831327 req-65d5f81f-455d-46b7-b3cd-f9eec391d1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71898013-5f2c-4fe1-95e5-ca068eece196", "tag": "a42d676a-2b05-4f5e-b0d3-1587e3c2e587"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:50:59.792690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-d62876a5-c22c-481d-8046-c4d6c5831327 req-65d5f81f-455d-46b7-b3cd-f9eec391d1b3 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:50:59.793624 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-d62876a5-c22c-481d-8046-c4d6c5831327 req-65d5f81f-455d-46b7-b3cd-f9eec391d1b3 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:50:59.794167 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-d62876a5-c22c-481d-8046-c4d6c5831327 req-65d5f81f-455d-46b7-b3cd-f9eec391d1b3 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:50:59.807560 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-d62876a5-c22c-481d-8046-c4d6c5831327 req-65d5f81f-455d-46b7-b3cd-f9eec391d1b3 service nova] Creating event network-changed:a42d676a-2b05-4f5e-b0d3-1587e3c2e587 for instance 71898013-5f2c-4fe1-95e5-ca068eece196 on hv-cinder-84456 Sep 28 08:50:59.813800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-d62876a5-c22c-481d-8046-c4d6c5831327 req-65d5f81f-455d-46b7-b3cd-f9eec391d1b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042274 Sep 28 08:50:59.814737 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 533/1035] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:51:00.104874 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:00.105516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:00.111795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:00.112324 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:00.112781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:00.113482 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:00.113933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:00.114355 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:00.262380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:00.272279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-acc5049d-6127-4fe3-8459-be6b4129d574 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.171348 Sep 28 08:51:00.273732 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 503/1036] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:00 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:01.300809 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:01.301687 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:01.309303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:01.310022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:01.310740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:01.311923 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:01.312405 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:01.312824 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:01.534050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:01.552314 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-f638a658-1f2c-40e4-9ac7-e888f5ecf32a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.256875 Sep 28 08:51:01.553507 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 534/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:01 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:51:02.576781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:02.577597 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:02.585632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:02.586403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:02.587343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:02.588131 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:02.588586 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:02.589015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:02.739427 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:02.747456 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fee6df96-e639-48a7-9b92-51ca8cf5bc82 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.175544 Sep 28 08:51:02.748149 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 504/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:02 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:03.777721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:03.778378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:03.785707 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:03.786205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:03.786645 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:03.787349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:03.787800 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:03.788226 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:03.933544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:03.943222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-91295298-debb-45a5-bfa3-4477efe49780 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.174781 Sep 28 08:51:03.953361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 535/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:03 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:04.966910 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:04.967536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:04.974010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:04.974515 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:04.974939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:04.975625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:04.976075 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:04.976493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:05.106579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:05.114594 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f2a7c283-6d4a-4092-9cd3-b39cfc54fa2e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.151618 Sep 28 08:51:05.115144 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 505/1040] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:04 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:05.218037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-975648166", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "networks": [{"uuid": "9a595026-5b6b-4111-8b06-dc75a0d359c7"}]}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:05.271876 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] validate_networks() for [('9a595026-5b6b-4111-8b06-dc75a0d359c7', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:51:05.644202 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:51:05.644639 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:51:05.645131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:51:05.645543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:51:05.645954 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:51:05.654755 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:05.655232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:05.655664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:05.656386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:05.656836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:05.657298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:05.674992 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Getting quotas for project 63011f747824422da9f24e5aa43a57ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:51:05.679255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Getting quotas for user ef7a012e1303456ea7abc94e96656199 and project 63011f747824422da9f24e5aa43a57ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:51:05.690026 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:51:05.692327 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:51:05.739257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8a86ec21-6996-41b2-854a-f54401665b2d tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525171 Sep 28 08:51:05.739940 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 536/1041] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:51:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:51:05.750985 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0bfcbe79-1ada-470e-9b2d-7c5137cda286 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:05.751718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0bfcbe79-1ada-470e-9b2d-7c5137cda286 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:05.805231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0bfcbe79-1ada-470e-9b2d-7c5137cda286 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:05.812424 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0bfcbe79-1ada-470e-9b2d-7c5137cda286 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1213 microversion: 2.1 time: 0.065348 Sep 28 08:51:05.813361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 506/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:05 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:06.138786 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:06.139401 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:06.146902 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:06.147385 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:06.147822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:06.148539 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:06.148991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:06.149440 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:06.280494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:06.288129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-aa49b3a5-58a4-41f4-a41f-7a8f85949eb6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.153440 Sep 28 08:51:06.288690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 537/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:06 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:06.835169 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:06.835791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:06.842778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:06.843255 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:06.843683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:06.844367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:06.844810 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:06.845255 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:06.904597 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:06.913243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-be4f9f85-70e8-4b5e-b9fe-15044e77289f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1217 microversion: 2.1 time: 0.081967 Sep 28 08:51:06.913811 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 507/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:06 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:07.311430 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:07.312036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:07.318701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:07.319188 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:07.319629 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:07.320357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:07.320829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:07.321294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:07.453625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:07.461976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-325f864c-4125-4996-83b1-4b448674df04 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.154418 Sep 28 08:51:07.462540 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 538/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:07 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:07.938805 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:07.939350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:07.946321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:07.946802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:07.947236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:07.947924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:07.948376 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:07.948804 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:08.012177 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:08.019774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-48eea01a-1a1c-4b04-b8c2-bae9c57f1836 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1217 microversion: 2.1 time: 0.084904 Sep 28 08:51:08.020338 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 508/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:07 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:08.484234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:08.484840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:08.491838 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:08.492319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:08.492753 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:08.493472 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:08.493922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:08.494345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:08.627563 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:08.635207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3b5f98d2-9e0e-4db4-a02e-f61c2fce82fe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.154906 Sep 28 08:51:08.635768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 539/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:08 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:09.042493 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:09.043111 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:09.049924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:09.050412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:09.050849 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:09.051544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:09.052008 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:09.052431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:09.112235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:09.119767 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-240cf353-106f-4c8a-bdb3-d0786412b6ff tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1217 microversion: 2.1 time: 0.081252 Sep 28 08:51:09.120340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 509/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:09 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:09.659206 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:09.659829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:09.666256 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:09.666732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:09.667160 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:09.667838 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:09.668280 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:09.668696 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:09.806618 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:09.814250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-61e63f29-f803-452e-8d0e-8e8ab63b5f0a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.159466 Sep 28 08:51:09.814831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 540/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:09 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:10.143489 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:10.144105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:10.150584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:10.151066 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:10.151500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:10.152189 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:10.152653 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:10.153078 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:10.212920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:10.220344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6dc62377-0021-41b3-9b61-b07bf8dd9124 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1209 microversion: 2.1 time: 0.081349 Sep 28 08:51:10.220899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 510/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:10 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:10.836717 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:10.837511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:10.844196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:10.845011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:10.845680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:10.846922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:10.847740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:10.848253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:11.018115 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:11.027249 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bbb52a30-e672-49a4-93c8-f2e0be96a2ed tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.194628 Sep 28 08:51:11.028157 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 541/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:10 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:11.244163 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:11.244591 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:11.251629 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:11.252430 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:11.253082 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:11.253999 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:11.254657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:11.255412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:11.325485 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:11.334584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7010f066-7ee6-4963-b6dc-fa6572f39480 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1273 microversion: 2.1 time: 0.094645 Sep 28 08:51:11.335496 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 511/1052] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:11 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:12.050671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:12.051290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:12.057932 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:12.058421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:12.058861 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:12.059561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:12.060015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:12.060445 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:12.205484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:12.214905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d9aeade9-1fbf-4afb-b77a-908c57fd30b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.167866 Sep 28 08:51:12.215603 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 542/1053] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:12 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:12.359798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:12.360408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:12.367437 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:12.368071 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:12.368510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:12.369245 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:12.369697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:12.370123 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:12.513104 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:12.523611 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e0a1170b-2efa-4ff9-a04b-599e08556281 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1313 microversion: 2.1 time: 0.167901 Sep 28 08:51:12.535692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 512/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:12 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:12.755486 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-81849ce2-ff34-4caf-b4e6-974cadc944c2 req-7115f2d6-eeaf-407e-9820-85d77b663c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6b87e54-885d-484c-b251-1d43e0b70d4a", "tag": "2083e6f0-8674-4fbe-8e8e-9c233fb8a7aa"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:12.765197 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81849ce2-ff34-4caf-b4e6-974cadc944c2 req-7115f2d6-eeaf-407e-9820-85d77b663c40 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:12.765610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81849ce2-ff34-4caf-b4e6-974cadc944c2 req-7115f2d6-eeaf-407e-9820-85d77b663c40 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:12.766035 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-81849ce2-ff34-4caf-b4e6-974cadc944c2 req-7115f2d6-eeaf-407e-9820-85d77b663c40 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:12.778244 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-81849ce2-ff34-4caf-b4e6-974cadc944c2 req-7115f2d6-eeaf-407e-9820-85d77b663c40 service nova] Creating event network-changed:2083e6f0-8674-4fbe-8e8e-9c233fb8a7aa for instance f6b87e54-885d-484c-b251-1d43e0b70d4a on hv-cinder-84456 Sep 28 08:51:12.785420 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-81849ce2-ff34-4caf-b4e6-974cadc944c2 req-7115f2d6-eeaf-407e-9820-85d77b663c40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033415 Sep 28 08:51:12.786111 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 543/1055] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:51:13.238523 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:13.239043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:13.245609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:13.246179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:13.246777 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:13.247477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:13.247936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:13.248361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:13.387920 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:13.397697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-63082730-e7e2-405e-bd7f-89a7951f46bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.163560 Sep 28 08:51:13.398264 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 513/1056] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:13 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:13.551093 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:13.551705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:13.558778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:13.559270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:13.559701 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:13.560443 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:13.560833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:13.561289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:13.580369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-9dc51869-9edc-4bc6-b989-0cdc2eafaeb9 req-27876b0c-f8ea-4c6b-8d76-b6cf8e1e3c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71898013-5f2c-4fe1-95e5-ca068eece196", "name": "network-vif-plugged", "status": "completed", "tag": "a42d676a-2b05-4f5e-b0d3-1587e3c2e587"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:13.590889 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-9dc51869-9edc-4bc6-b989-0cdc2eafaeb9 req-27876b0c-f8ea-4c6b-8d76-b6cf8e1e3c0d service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:13.591375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-9dc51869-9edc-4bc6-b989-0cdc2eafaeb9 req-27876b0c-f8ea-4c6b-8d76-b6cf8e1e3c0d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:13.591810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-9dc51869-9edc-4bc6-b989-0cdc2eafaeb9 req-27876b0c-f8ea-4c6b-8d76-b6cf8e1e3c0d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:13.607326 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-9dc51869-9edc-4bc6-b989-0cdc2eafaeb9 req-27876b0c-f8ea-4c6b-8d76-b6cf8e1e3c0d service nova] Creating event network-vif-plugged:a42d676a-2b05-4f5e-b0d3-1587e3c2e587 for instance 71898013-5f2c-4fe1-95e5-ca068eece196 on hv-cinder-84456 Sep 28 08:51:13.613414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-9dc51869-9edc-4bc6-b989-0cdc2eafaeb9 req-27876b0c-f8ea-4c6b-8d76-b6cf8e1e3c0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177104 Sep 28 08:51:13.614140 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 544/1057] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:51:13.712152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:13.718213 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-b6b035b3-aec0-4724-b2bd-d8c94ecb7d04 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1313 microversion: 2.1 time: 0.171430 Sep 28 08:51:13.719524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 514/1058] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:13 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:14.422083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:14.422965 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:14.429851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:14.430572 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:14.431258 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:14.432034 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:14.432482 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:14.432912 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:14.577315 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:14.585441 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-bc3eb563-4edf-4d0d-84e6-a288be4b5773 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.168208 Sep 28 08:51:14.600501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 545/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:14 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:14.746012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:14.746638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:14.754005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:14.754722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:14.755162 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:14.755863 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:14.756321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:14.756833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:14.893608 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:14.901638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d190a55a-c2dc-4682-948e-12af4d5d6e06 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1313 microversion: 2.1 time: 0.159535 Sep 28 08:51:14.902136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 515/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:14 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:15.608500 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:15.609069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:15.615829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:15.616326 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:15.616759 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:15.617491 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:15.617942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:15.618361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:15.664474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=4 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:15.685506 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=12 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:15.786926 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:15.795895 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-708d47db-5aaa-41f7-b3fd-cb3373afd30b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.191801 Sep 28 08:51:15.797412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 546/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:15 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:15.924838 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:15.925497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:15.932096 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=4 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:15.941678 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:15.942521 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:15.943596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:15.944991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:15.950604 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:15.951690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:16.103369 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:16.111236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1d8c2786-8c01-4a02-8b92-d4982f28dce2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1313 microversion: 2.1 time: 0.191053 Sep 28 08:51:16.111824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 516/1062] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:15 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:16.820824 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:16.822093 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:16.828606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:16.829490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:16.829930 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:16.830884 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:16.831400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:16.831768 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:16.972487 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:16.980757 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-aceda223-e658-472f-89f8-ddc2b5eca05a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1266 microversion: 2.1 time: 0.164290 Sep 28 08:51:16.981484 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 547/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:16 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:17.135529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:17.136142 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:17.142637 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:17.143128 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:17.143564 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:17.144259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:17.144718 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:17.145184 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:17.280123 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:17.290395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-17366bc8-c1a5-4b58-b28e-cd6416b7ecb5 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1313 microversion: 2.1 time: 0.158513 Sep 28 08:51:17.291435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 517/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:17 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:17.583473 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-44c9505f-7e8a-412f-8ccb-f2adb7a833f2 req-3d195fb4-6256-46f7-9632-1ae2ec274bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b87e54-885d-484c-b251-1d43e0b70d4a", "name": "network-vif-plugged", "status": "completed", "tag": "2083e6f0-8674-4fbe-8e8e-9c233fb8a7aa"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:17.594609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-44c9505f-7e8a-412f-8ccb-f2adb7a833f2 req-3d195fb4-6256-46f7-9632-1ae2ec274bc0 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:17.595156 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-44c9505f-7e8a-412f-8ccb-f2adb7a833f2 req-3d195fb4-6256-46f7-9632-1ae2ec274bc0 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:17.595598 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-44c9505f-7e8a-412f-8ccb-f2adb7a833f2 req-3d195fb4-6256-46f7-9632-1ae2ec274bc0 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:17.607866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-44c9505f-7e8a-412f-8ccb-f2adb7a833f2 req-3d195fb4-6256-46f7-9632-1ae2ec274bc0 service nova] Creating event network-vif-plugged:2083e6f0-8674-4fbe-8e8e-9c233fb8a7aa for instance f6b87e54-885d-484c-b251-1d43e0b70d4a on hv-cinder-84456 Sep 28 08:51:17.612893 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-44c9505f-7e8a-412f-8ccb-f2adb7a833f2 req-3d195fb4-6256-46f7-9632-1ae2ec274bc0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033869 Sep 28 08:51:17.613530 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 548/1065] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:51:18.004952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:18.006345 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:18.012463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:18.012966 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:18.013446 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:18.014154 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:18.014612 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:18.015038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:18.183697 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:18.192011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fdd53513-2d16-40ae-982c-2ec9557e941f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1452 microversion: 2.1 time: 0.191726 Sep 28 08:51:18.192627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 518/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:17 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1452 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:18.216349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:18.217046 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:18.223190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:18.223671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:18.224101 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:18.224787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:18.225273 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:18.225698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:18.316003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:18.316944 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:18.322880 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:18.323379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:18.323824 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:18.324537 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:18.324998 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:18.325475 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:18.344623 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=100 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:18.364904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:18.372690 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-edf9f698-229b-4e19-a2a5-bc128937c991 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1452 microversion: 2.1 time: 0.161071 Sep 28 08:51:18.373384 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 549/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:18 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:18.465281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:18.473275 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6d246758-fb2a-4867-861d-f4ff3ea4c157 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1313 microversion: 2.1 time: 0.162144 Sep 28 08:51:18.473846 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 519/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:18 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:51:19.496310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:19.497672 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:19.516959 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:19.520047 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:19.521457 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:19.522395 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:19.527195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:19.528747 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:19.691241 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:19.701450 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-86a0fe89-d22b-4f00-a119-958c9d3b2f17 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1313 microversion: 2.1 time: 0.209077 Sep 28 08:51:19.702101 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 550/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:19 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:20.216963 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-70dc74e7-9b81-4b62-8eb8-ed013c6e9a4a req-95c05814-0718-4b94-a2cb-a57a285d886a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71898013-5f2c-4fe1-95e5-ca068eece196", "tag": "a42d676a-2b05-4f5e-b0d3-1587e3c2e587"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:20.227344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-70dc74e7-9b81-4b62-8eb8-ed013c6e9a4a req-95c05814-0718-4b94-a2cb-a57a285d886a service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:20.227864 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-70dc74e7-9b81-4b62-8eb8-ed013c6e9a4a req-95c05814-0718-4b94-a2cb-a57a285d886a service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:20.228382 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-70dc74e7-9b81-4b62-8eb8-ed013c6e9a4a req-95c05814-0718-4b94-a2cb-a57a285d886a service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:20.242990 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-70dc74e7-9b81-4b62-8eb8-ed013c6e9a4a req-95c05814-0718-4b94-a2cb-a57a285d886a service nova] Creating event network-changed:a42d676a-2b05-4f5e-b0d3-1587e3c2e587 for instance 71898013-5f2c-4fe1-95e5-ca068eece196 on hv-cinder-84456 Sep 28 08:51:20.248536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-70dc74e7-9b81-4b62-8eb8-ed013c6e9a4a req-95c05814-0718-4b94-a2cb-a57a285d886a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035218 Sep 28 08:51:20.249364 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 520/1070] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:51:20.734843 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:20.735474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:20.750375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:20.750876 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:20.753478 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:20.757072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:20.760120 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:20.760560 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:20.803792 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=100 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:20.985598 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:20.995343 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-99762c9f-dd4a-467b-987f-602847cd98ac tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1498 microversion: 2.1 time: 0.264764 Sep 28 08:51:21.009542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 551/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:20 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:22.116691 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:22.117370 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:22.124164 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:22.124648 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:22.125107 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:22.125800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:22.126263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:22.126688 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:22.151992 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:51:22.230802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f8396840-cc4b-43bc-a74b-e956f7467937 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 204 len: 0 microversion: 2.1 time: 0.117998 Sep 28 08:51:22.231625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 521/1072] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:51:22 2022] DELETE /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:51:22.240392 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:22.241218 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:22.247970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:22.248544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:22.249655 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:22.250440 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:22.250999 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:22.251522 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:22.391116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:22.404427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-47c5777d-de13-46ea-95b0-53cd029a5405 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1504 microversion: 2.1 time: 0.168412 Sep 28 08:51:22.405215 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 552/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:22 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:23.431207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:23.431909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:23.438278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:23.438763 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:23.439206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:23.439897 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:23.440354 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:23.440779 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:23.578043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:23.587132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bd8fecf1-c95d-458d-9d55-190219f910a3 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1504 microversion: 2.1 time: 0.160032 Sep 28 08:51:23.587827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 522/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:23 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:24.339240 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-c17ea634-bc2f-47cf-87a9-37bca11c01d2 req-c6e8ecee-3f18-4484-970c-3e343bead093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6b87e54-885d-484c-b251-1d43e0b70d4a", "name": "network-vif-deleted", "tag": "2083e6f0-8674-4fbe-8e8e-9c233fb8a7aa"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:24.357307 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c17ea634-bc2f-47cf-87a9-37bca11c01d2 req-c6e8ecee-3f18-4484-970c-3e343bead093 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:24.357796 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c17ea634-bc2f-47cf-87a9-37bca11c01d2 req-c6e8ecee-3f18-4484-970c-3e343bead093 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:24.358233 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-c17ea634-bc2f-47cf-87a9-37bca11c01d2 req-c6e8ecee-3f18-4484-970c-3e343bead093 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:24.370388 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-c17ea634-bc2f-47cf-87a9-37bca11c01d2 req-c6e8ecee-3f18-4484-970c-3e343bead093 service nova] Creating event network-vif-deleted:2083e6f0-8674-4fbe-8e8e-9c233fb8a7aa for instance f6b87e54-885d-484c-b251-1d43e0b70d4a on hv-cinder-84456 Sep 28 08:51:24.375244 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-c17ea634-bc2f-47cf-87a9-37bca11c01d2 req-c6e8ecee-3f18-4484-970c-3e343bead093 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043136 Sep 28 08:51:24.375851 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 553/1075] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:51:24.617642 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:24.618249 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:24.624501 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:24.624979 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:24.625450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:24.626135 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:24.626582 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:24.627677 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:24.657063 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:24.657563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:24.658497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:24.658947 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.objects.instance [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lazy-loading 'fault' on Instance uuid f6b87e54-885d-484c-b251-1d43e0b70d4a {{(pid=127110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:51:24.699990 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:24.707694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e9495953-14fd-4e07-a665-299f6ece5116 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 200 len: 1303 microversion: 2.1 time: 0.093886 Sep 28 08:51:24.708263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 523/1076] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:24 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:25.732964 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:25.733726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f6b87e54-885d-484c-b251-1d43e0b70d4a] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:25.735567 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:25.741557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:25.742039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:25.742466 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:25.743161 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:25.743603 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:25.744025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:25.760423 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] HTTP exception thrown: Instance f6b87e54-885d-484c-b251-1d43e0b70d4a could not be found. Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Request method failure captured: Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a HTTP/1.1 Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAr35H0p4HBKxXxvoSRBwkhWsfA2FH_KEkoBJ9yL1iQ2qsfAlrSckXUlSb1wCSAo0V6aXcNDW1f6S_V1616mELU0YrXaupNVyOP6ZhfzA5EM76HxFKyvPqt3QBi1Evjf0n-m2Wfdzd58Ei4Y5-WpVMuvtPaaqBpIq7MVb6qtBbMNzjw Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: 63011f747824422da9f24e5aa43a57ad Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-VolumesActionsTest-1731916987 Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:51:25.762092 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/63011f747824422da9f24e5aa43a57ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/63011f747824422da9f24e5aa43a57ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/63011f747824422da9f24e5aa43a57ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_63011f747824422da9f24e5aa43a57ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-VolumesActionsTest-1731916987 Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: 63011f747824422da9f24e5aa43a57ad Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-VolumesActionsTest-1731916987 Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-VolumesActionsTest-1731916987-project Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: ef7a012e1303456ea7abc94e96656199 Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-VolumesActionsTest-1731916987-project Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance f6b87e54-885d-484c-b251-1d43e0b70d4a could not be found. Sep 28 08:51:25.763780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': 'f6b87e54-885d-484c-b251-1d43e0b70d4a'} Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6b87e54-885d-484c-b251-1d43e0b70d4a could not be found. Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:51:25.767253 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6b87e54-885d-484c-b251-1d43e0b70d4a could not be found. Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6b87e54-885d-484c-b251-1d43e0b70d4a could not be found. Sep 28 08:51:25.768831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:51:25.770208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Returning 404 to user: Instance f6b87e54-885d-484c-b251-1d43e0b70d4a could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:51:25.770208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dc9a144d-c560-49de-8686-710477dde354 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a" status: 404 len: 111 microversion: 2.1 time: 0.035382 Sep 28 08:51:25.770208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 554/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:25 2022] GET /compute/v2.1/servers/f6b87e54-885d-484c-b251-1d43e0b70d4a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:51:25.869596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-723742823", "imageRef": "d8816fc8-3f18-4ea6-9b78-0a6db2947b79", "flavorRef": "452", "networks": [{"uuid": "9a595026-5b6b-4111-8b06-dc75a0d359c7"}]}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:25.926018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] validate_networks() for [('9a595026-5b6b-4111-8b06-dc75a0d359c7', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:51:26.440635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:51:26.441062 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:51:26.441622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:51:26.442256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:51:26.442674 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:51:26.451464 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:26.451955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:26.452391 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:26.453146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:26.453607 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:26.454030 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:26.471282 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Getting quotas for project 63011f747824422da9f24e5aa43a57ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:51:26.475233 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Getting quotas for user ef7a012e1303456ea7abc94e96656199 and project 63011f747824422da9f24e5aa43a57ad. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:51:26.487638 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:51:26.490333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8816fc8-3f18-4ea6-9b78-0a6db2947b79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:51:26.539188 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [24bc953a-d42a-47ec-b533-db5f9189f39c] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 08:51:27.547367 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO oslo.messaging._drivers.impl_rabbit [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [24bc953a-d42a-47ec-b533-db5f9189f39c] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57208. Sep 28 08:51:27.551860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fade2d34-2bd8-474a-9497-ab2ad48b3dd4 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689309 Sep 28 08:51:27.552514 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 524/1078] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:51:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 08:51:27.563524 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ce4e8ad1-53c9-4499-b1b5-d4c0a90bcc98 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:27.564196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ce4e8ad1-53c9-4499-b1b5-d4c0a90bcc98 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:27.619345 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ce4e8ad1-53c9-4499-b1b5-d4c0a90bcc98 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:27.626168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ce4e8ad1-53c9-4499-b1b5-d4c0a90bcc98 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1213 microversion: 2.1 time: 0.066530 Sep 28 08:51:27.626721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 555/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:27 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:28.649010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:28.650052 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:28.653143 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:28.658872 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:28.659498 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:28.660005 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:28.660968 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:28.661511 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:28.662195 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:28.731892 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:28.742716 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f6548866-efde-4454-8d22-b242e782bf57 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1273 microversion: 2.1 time: 0.097997 Sep 28 08:51:28.745736 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 525/1080] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:28 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:29.766719 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:29.767848 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:29.775224 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:29.775721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:29.776200 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:29.777497 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:29.778132 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:29.778726 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:29.915854 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:29.923693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-79200876-f7b1-4c05-9b69-9b4c964f620c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1313 microversion: 2.1 time: 0.160899 Sep 28 08:51:29.924250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 556/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:29 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:29.984971 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-b5b1de98-1c5e-4fbf-8f9c-16d3351b602c req-6d97fd7e-b760-4005-97b5-c17872b7c59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f73377e8-922f-450d-890d-29fa6cf62a4f", "tag": "771e0c55-b4e9-46f9-abd0-d628de1dcbb0"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:29.997613 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b5b1de98-1c5e-4fbf-8f9c-16d3351b602c req-6d97fd7e-b760-4005-97b5-c17872b7c59a service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:29.998087 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b5b1de98-1c5e-4fbf-8f9c-16d3351b602c req-6d97fd7e-b760-4005-97b5-c17872b7c59a service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:29.998612 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b5b1de98-1c5e-4fbf-8f9c-16d3351b602c req-6d97fd7e-b760-4005-97b5-c17872b7c59a service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:30.010952 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-b5b1de98-1c5e-4fbf-8f9c-16d3351b602c req-6d97fd7e-b760-4005-97b5-c17872b7c59a service nova] Creating event network-changed:771e0c55-b4e9-46f9-abd0-d628de1dcbb0 for instance f73377e8-922f-450d-890d-29fa6cf62a4f on hv-cinder-84456 Sep 28 08:51:30.016083 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-b5b1de98-1c5e-4fbf-8f9c-16d3351b602c req-6d97fd7e-b760-4005-97b5-c17872b7c59a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034885 Sep 28 08:51:30.016689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 526/1082] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:51:30.946739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:30.947370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:30.953794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:30.954293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:30.954752 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:30.955415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:30.955844 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:30.956264 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:31.082978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:31.090570 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d13285d0-b2fd-424b-8d6a-34986759e257 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1313 microversion: 2.1 time: 0.147774 Sep 28 08:51:31.091128 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 557/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:30 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:32.115054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:32.115753 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:32.121930 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:32.122415 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:32.122848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:32.123533 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:32.123983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:32.124406 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:32.254152 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:32.261756 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-694b6bd3-e560-417e-9133-376e0718e4ce tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1313 microversion: 2.1 time: 0.151940 Sep 28 08:51:32.262318 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 527/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:32 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:33.284036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:33.284623 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:33.290948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:33.291434 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:33.291849 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:33.292534 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:33.292979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:33.293424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:33.424647 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:33.433168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-95b1832d-46cf-4683-ade3-15805898cfc2 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1313 microversion: 2.1 time: 0.153086 Sep 28 08:51:33.433733 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 558/1085] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:33 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:34.455830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:34.456584 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:34.463504 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:34.463990 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:34.464421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:34.465132 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:34.465586 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:34.466010 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:34.601601 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:34.609375 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bd89aeba-a013-4a19-b191-29362f7df8e9 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1313 microversion: 2.1 time: 0.157367 Sep 28 08:51:34.609939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 528/1086] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:34 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:35.557381 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-89b3d00a-ae89-42eb-bed9-64242445f112 req-3097346c-e7a1-44fa-b1b3-474f2a4f7be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73377e8-922f-450d-890d-29fa6cf62a4f", "name": "network-vif-plugged", "status": "completed", "tag": "771e0c55-b4e9-46f9-abd0-d628de1dcbb0"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:35.568559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-89b3d00a-ae89-42eb-bed9-64242445f112 req-3097346c-e7a1-44fa-b1b3-474f2a4f7be9 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:35.569151 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-89b3d00a-ae89-42eb-bed9-64242445f112 req-3097346c-e7a1-44fa-b1b3-474f2a4f7be9 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:35.569612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-89b3d00a-ae89-42eb-bed9-64242445f112 req-3097346c-e7a1-44fa-b1b3-474f2a4f7be9 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:35.587070 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-89b3d00a-ae89-42eb-bed9-64242445f112 req-3097346c-e7a1-44fa-b1b3-474f2a4f7be9 service nova] Creating event network-vif-plugged:771e0c55-b4e9-46f9-abd0-d628de1dcbb0 for instance f73377e8-922f-450d-890d-29fa6cf62a4f on hv-cinder-84456 Sep 28 08:51:35.592375 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-89b3d00a-ae89-42eb-bed9-64242445f112 req-3097346c-e7a1-44fa-b1b3-474f2a4f7be9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038788 Sep 28 08:51:35.593193 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 559/1087] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:51:35.632689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:35.633332 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:35.639214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:35.639708 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:35.640146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:35.640851 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:35.641337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:35.641765 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:35.779081 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:35.787585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-7f7028a0-0174-491f-b6a0-5f992cdebb6a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1313 microversion: 2.1 time: 0.159328 Sep 28 08:51:35.788158 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 529/1088] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:35 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:36.811459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:36.812160 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:36.818261 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:36.818728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:36.819156 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:36.819829 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:36.820277 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:36.820693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:36.947390 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:36.954859 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-06819150-e68a-4295-8bf3-3390fc3c196c tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1313 microversion: 2.1 time: 0.148130 Sep 28 08:51:36.955409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 560/1089] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:36 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:37.978887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:37.979495 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:37.981429 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:37.982210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:37.988054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:37.988536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:37.988969 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:37.989686 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:37.990140 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:37.990693 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:38.117657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:38.125352 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-680c37f3-ef43-4d12-8b4b-13d2f9f0734f tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1497 microversion: 2.1 time: 0.150374 Sep 28 08:51:38.125919 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 530/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:37 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:38.657780 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:38.658311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:38.660223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:51:38.666318 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:38.666789 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:38.667308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:38.667972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:38.668398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:38.668821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:38.694735 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:51:38.771924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fabadf38-a5b7-4725-bd19-6ebccb3f6e5a tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 204 len: 0 microversion: 2.1 time: 0.117784 Sep 28 08:51:38.772521 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 561/1091] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:51:38 2022] DELETE /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:51:38.782443 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:38.783061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:38.789707 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:38.790226 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:38.790669 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:38.791379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:38.791833 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:38.792263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:38.923288 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:38.930991 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-793c4281-81e2-49f7-b309-f76ac851651b tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1503 microversion: 2.1 time: 0.153139 Sep 28 08:51:38.931558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 531/1092] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:38 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:39.953881 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:39.954518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:39.961409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:39.961894 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:39.962324 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:39.963015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:39.963465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:39.963890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:40.090349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:40.098642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-04dc5ac2-26d8-42e4-9ab5-7ce4e4316c8e tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1503 microversion: 2.1 time: 0.149259 Sep 28 08:51:40.099208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 562/1093] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:39 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:41.002240 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-5031ad01-64f7-4370-b9a6-c533a27eb4a8 req-7734a43f-ebcd-40e1-8b86-b3cfc6d1546d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f73377e8-922f-450d-890d-29fa6cf62a4f", "name": "network-vif-deleted", "tag": "771e0c55-b4e9-46f9-abd0-d628de1dcbb0"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:51:41.012663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-5031ad01-64f7-4370-b9a6-c533a27eb4a8 req-7734a43f-ebcd-40e1-8b86-b3cfc6d1546d service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:41.013171 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-5031ad01-64f7-4370-b9a6-c533a27eb4a8 req-7734a43f-ebcd-40e1-8b86-b3cfc6d1546d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:41.013607 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-5031ad01-64f7-4370-b9a6-c533a27eb4a8 req-7734a43f-ebcd-40e1-8b86-b3cfc6d1546d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:41.025787 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-5031ad01-64f7-4370-b9a6-c533a27eb4a8 req-7734a43f-ebcd-40e1-8b86-b3cfc6d1546d service nova] Creating event network-vif-deleted:771e0c55-b4e9-46f9-abd0-d628de1dcbb0 for instance f73377e8-922f-450d-890d-29fa6cf62a4f on hv-cinder-84456 Sep 28 08:51:41.030803 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-5031ad01-64f7-4370-b9a6-c533a27eb4a8 req-7734a43f-ebcd-40e1-8b86-b3cfc6d1546d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032220 Sep 28 08:51:41.031452 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 532/1094] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:51:41.121378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:41.121998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:41.128836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:41.129427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:41.129867 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:41.130561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:41.131015 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:41.131443 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:41.162700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:41.163185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:41.163626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:41.164073 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lazy-loading 'fault' on Instance uuid f73377e8-922f-450d-890d-29fa6cf62a4f {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:51:41.212609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef7a012e1303456ea7abc94e96656199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63011f747824422da9f24e5aa43a57ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:51:41.222417 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-eac80ec3-e42a-4b20-8bee-3971f792c6dd tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 200 len: 1303 microversion: 2.1 time: 0.104601 Sep 28 08:51:41.222961 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 563/1095] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:41 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:51:42.247091 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:51:42.247817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] [instance: f73377e8-922f-450d-890d-29fa6cf62a4f] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:51:42.255529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:42.256230 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:42.256783 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:42.257663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:51:42.258161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:51:42.258589 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:51:42.273055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] HTTP exception thrown: Instance f73377e8-922f-450d-890d-29fa6cf62a4f could not be found. Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Request method failure captured: Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f HTTP/1.1 Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNAr35H0p4HBKxXxvoSRBwkhWsfA2FH_KEkoBJ9yL1iQ2qsfAlrSckXUlSb1wCSAo0V6aXcNDW1f6S_V1616mELU0YrXaupNVyOP6ZhfzA5EM76HxFKyvPqt3QBi1Evjf0n-m2Wfdzd58Ei4Y5-WpVMuvtPaaqBpIq7MVb6qtBbMNzjw Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: 63011f747824422da9f24e5aa43a57ad Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-VolumesActionsTest-1731916987 Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:51:42.274774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/63011f747824422da9f24e5aa43a57ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/63011f747824422da9f24e5aa43a57ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/63011f747824422da9f24e5aa43a57ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_63011f747824422da9f24e5aa43a57ad", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-VolumesActionsTest-1731916987 Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: 63011f747824422da9f24e5aa43a57ad Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-VolumesActionsTest-1731916987 Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-VolumesActionsTest-1731916987-project Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: ef7a012e1303456ea7abc94e96656199 Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-VolumesActionsTest-1731916987-project Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance f73377e8-922f-450d-890d-29fa6cf62a4f could not be found. Sep 28 08:51:42.276473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'f73377e8-922f-450d-890d-29fa6cf62a4f'} Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f73377e8-922f-450d-890d-29fa6cf62a4f could not be found. Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:51:42.277417 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f73377e8-922f-450d-890d-29fa6cf62a4f could not be found. Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f73377e8-922f-450d-890d-29fa6cf62a4f could not be found. Sep 28 08:51:42.279061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:51:42.280500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] Returning 404 to user: Instance f73377e8-922f-450d-890d-29fa6cf62a4f could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:51:42.280500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c6c30571-fd8b-41cc-85b4-b396a3765467 tempest-VolumesActionsTest-1731916987 tempest-VolumesActionsTest-1731916987-project] 10.222.0.52 "GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f" status: 404 len: 111 microversion: 2.1 time: 0.034037 Sep 28 08:51:42.280500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 533/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:51:42 2022] GET /compute/v2.1/servers/f73377e8-922f-450d-890d-29fa6cf62a4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:53:09.754204 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:09.755149 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:09.760945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-64a35a0e-987c-431a-827f-742479eba5c6 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Action: 'create', calling method: .version_select at 0x7f984fd5e940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1043301925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+pdMjEfylcg+0ldgV2ZS1U5/mhTPlsTIjMvYLu1RULi9VD3zGr82q7u68d9q5Xeo0Zw7X8Jpc/Stp2LCJNt6RtHshZ8F2BzbHhGpEpebkQgO+UoAsDOFxSqBl9MQcngA=="}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:09.780541 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-64a35a0e-987c-431a-827f-742479eba5c6 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Getting quotas for project a5865848bafe480db52b92ab3323645f. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:53:09.784287 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-64a35a0e-987c-431a-827f-742479eba5c6 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Getting quotas for user 7a41fc47ed5447af88710dd6e74523ce and project a5865848bafe480db52b92ab3323645f. Resources: {'key_pairs'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:53:09.808496 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-64a35a0e-987c-431a-827f-742479eba5c6 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056371 Sep 28 08:53:09.809115 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 564/1097] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Sep 28 08:53:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:53:09.857725 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=17 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:09.858467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:09.862750 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-290193511", "imageRef": "3f9f6326-f3e4-4e51-b5b6-f5f14457a487", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1043301925", "networks": [{"uuid": "b7ed4aba-b891-47c2-80b2-aaebeb5f007b"}]}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:10.029000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.network.neutron [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] validate_networks() for [('b7ed4aba-b891-47c2-80b2-aaebeb5f007b', None, None, None, None, None)] {{(pid=127110) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:53:10.403400 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Flavor limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:53:10.403827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Image limits 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:53:10.404299 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Flavor pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:53:10.404764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Image pref 0:0:0 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:53:10.405156 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.virt.hardware [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:53:10.414073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:10.414545 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:10.414974 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:10.415735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:10.416210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:10.416609 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:10.433165 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Getting quotas for project a5865848bafe480db52b92ab3323645f. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:53:10.437121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.quota [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Getting quotas for user 7a41fc47ed5447af88710dd6e74523ce and project a5865848bafe480db52b92ab3323645f. Resources: {'ram', 'cores', 'instances'} {{(pid=127110) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:53:10.448780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Going to run 1 instances... {{(pid=127110) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:53:10.451062 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f9f6326-f3e4-4e51-b5b6-f5f14457a487',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:53:10.498615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-50d69ac0-a2b5-4662-8b08-8871503b3ca4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643078 Sep 28 08:53:10.499257 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 534/1098] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:53:10.510294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dbc9d346-8d96-4f2f-adc8-5249d0188556 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:10.510905 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dbc9d346-8d96-4f2f-adc8-5249d0188556 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:10.678680 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-dbc9d346-8d96-4f2f-adc8-5249d0188556 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:10.685910 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dbc9d346-8d96-4f2f-adc8-5249d0188556 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1258 microversion: 2.1 time: 0.179612 Sep 28 08:53:10.686656 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 565/1099] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:10 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:11.708448 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:11.709306 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:11.716243 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:11.716731 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:11.717193 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:11.717893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:11.718340 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:11.718832 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:11.793745 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:11.801649 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e5bce1dd-c18a-4108-b2f9-7f0807ab1264 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1328 microversion: 2.1 time: 0.097679 Sep 28 08:53:11.802325 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 535/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:11 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:12.826150 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:12.826777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:12.834922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:12.835481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:12.836174 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:12.836888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:12.837377 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:12.837808 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:13.009289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:13.018041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-051a28fa-2711-41bf-944b-696c045cc6c3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.195852 Sep 28 08:53:13.032470 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 566/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:12 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:14.044642 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:14.045371 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:14.052327 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:14.052949 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:14.053412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:14.054113 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:14.054689 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:14.055304 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:14.209903 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:14.218869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-89c8fa99-90bc-4544-984e-5f876233f25b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.178458 Sep 28 08:53:14.219622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 536/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:14 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:15.242656 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:15.243964 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:15.250920 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:15.252190 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:15.252885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:15.253972 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:15.254613 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:15.255044 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:15.409490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:15.418658 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ab6989ad-364e-4378-88fa-7a7c954046ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.180256 Sep 28 08:53:15.419232 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 567/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:15 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:53:16.443916 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:16.444574 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:16.451817 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:16.452315 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:16.452983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:16.453739 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:16.454197 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:16.454628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:16.598358 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:16.607296 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-267d5c5f-4752-498d-9dd0-f289180c5358 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.168831 Sep 28 08:53:16.608074 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 537/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:16 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:17.630014 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:17.631361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:17.638544 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:17.639037 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:17.639483 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:17.640235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:17.642355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:17.642721 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:17.816803 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:17.824671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-523be7a0-f8bc-4438-843c-32c31169ca94 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.198669 Sep 28 08:53:17.825268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 568/1105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:17 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:53:18.851799 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:18.852759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:18.863806 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:18.865186 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:18.865912 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:18.867118 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:18.867871 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:18.868668 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:19.022012 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:19.031567 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-90a78d79-52a7-4479-977c-ac689205e8b0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.186871 Sep 28 08:53:19.032397 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 538/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:18 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:20.056457 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:20.057048 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:20.063448 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:20.063933 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:20.064373 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:20.065081 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:20.065548 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:20.065968 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:20.192516 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:20.200203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-cf8ba326-d076-4034-b5d4-39ce9f9ff30a tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.148427 Sep 28 08:53:20.200759 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 569/1107] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:20 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:21.222748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:21.223360 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:21.225714 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:21.226399 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=6 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:21.232286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:21.232778 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:21.233250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:21.233958 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:21.234412 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:21.234844 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:21.367473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:21.375295 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-6aaf09e9-0b7d-4a5b-b5bf-fe200be88aed tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.156387 Sep 28 08:53:21.375945 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 539/1108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:21 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:22.400321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:22.401116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:22.402996 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:22.410619 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:22.411106 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:22.411570 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:22.412326 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:22.412777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:22.413250 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:22.552820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:22.560691 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3f2ef65c-4466-40f8-99e5-a09ba596dfae tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.165670 Sep 28 08:53:22.561340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 570/1109] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:22 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:23.425265 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-996ae503-733d-4e23-8cd0-7dcc9105ae5b req-0467929b-f99b-452c-9d05-41aaa4010000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575ed4ff-93ec-4e2a-882e-ef9c582c0ee2", "tag": "46130deb-f05d-45a3-9209-b6a24b906549"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:23.437321 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-996ae503-733d-4e23-8cd0-7dcc9105ae5b req-0467929b-f99b-452c-9d05-41aaa4010000 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:23.438328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-996ae503-733d-4e23-8cd0-7dcc9105ae5b req-0467929b-f99b-452c-9d05-41aaa4010000 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:23.438328 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-996ae503-733d-4e23-8cd0-7dcc9105ae5b req-0467929b-f99b-452c-9d05-41aaa4010000 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:23.454251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-996ae503-733d-4e23-8cd0-7dcc9105ae5b req-0467929b-f99b-452c-9d05-41aaa4010000 service nova] Creating event network-changed:46130deb-f05d-45a3-9209-b6a24b906549 for instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 on hv-cinder-84456 Sep 28 08:53:23.459468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-996ae503-733d-4e23-8cd0-7dcc9105ae5b req-0467929b-f99b-452c-9d05-41aaa4010000 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037946 Sep 28 08:53:23.460272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 540/1110] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:53:23.588586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:23.590380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:23.597146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:23.597644 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:23.598490 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:23.599203 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:23.599664 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:23.600094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:23.734743 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:23.744674 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c4037d0e-07c2-41ae-84b8-aeedb2c07aef tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.161406 Sep 28 08:53:23.745637 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 571/1111] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:23 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:24.768549 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:24.769294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:24.776474 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:24.776951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:24.777404 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:24.778090 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:24.778544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:24.778961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:24.906543 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:24.914105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-2c39d4a3-2df5-41ed-977a-640838842218 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.149806 Sep 28 08:53:24.914670 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 541/1112] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:24 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:25.938481 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:25.939091 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:25.946222 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:25.946709 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:25.947146 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:25.947837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:25.948288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:25.948712 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:26.080099 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:26.087963 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-b4ba4892-2686-4077-8ed6-faa9bd86f9db tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.153356 Sep 28 08:53:26.088533 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 572/1113] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:25 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:27.111457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:27.112052 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:27.118569 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:27.119089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:27.119531 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:27.120234 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:27.120692 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:27.121146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:27.250995 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:27.258867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9fcf6328-c7cd-48d8-ba63-4c25114636ce tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.151284 Sep 28 08:53:27.259440 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 542/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:27 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:53:28.283074 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:28.283676 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:28.290072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:28.290543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:28.290970 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:28.291651 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:28.292097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:28.292519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:28.426543 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:28.434274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c08581f8-c7df-46bb-9019-c32c63328f9f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.155079 Sep 28 08:53:28.434837 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 573/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:28 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:29.429332 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-b8702a0d-16c6-42f3-ad20-9076ffed3817 req-950d4d5e-2d17-4b2e-b887-761477dd669a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575ed4ff-93ec-4e2a-882e-ef9c582c0ee2", "name": "network-vif-plugged", "status": "completed", "tag": "46130deb-f05d-45a3-9209-b6a24b906549"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:29.439989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b8702a0d-16c6-42f3-ad20-9076ffed3817 req-950d4d5e-2d17-4b2e-b887-761477dd669a service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:29.440471 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b8702a0d-16c6-42f3-ad20-9076ffed3817 req-950d4d5e-2d17-4b2e-b887-761477dd669a service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:29.440894 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b8702a0d-16c6-42f3-ad20-9076ffed3817 req-950d4d5e-2d17-4b2e-b887-761477dd669a service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:29.451848 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-b8702a0d-16c6-42f3-ad20-9076ffed3817 req-950d4d5e-2d17-4b2e-b887-761477dd669a service nova] Creating event network-vif-plugged:46130deb-f05d-45a3-9209-b6a24b906549 for instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 on hv-cinder-84456 Sep 28 08:53:29.457068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-b8702a0d-16c6-42f3-ad20-9076ffed3817 req-950d4d5e-2d17-4b2e-b887-761477dd669a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031719 Sep 28 08:53:29.458403 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 543/1116] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:53:29.459131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:29.460010 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:29.466361 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:29.466840 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:29.467273 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:29.467974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:29.468424 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:29.468847 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:29.616060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:29.623842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8ebe823d-4049-4e99-a23c-dc64f4f76252 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.170103 Sep 28 08:53:29.624679 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 574/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:29 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:30.650366 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:30.651062 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:30.657447 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:30.657927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:30.658354 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:30.659041 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:30.659488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:30.659908 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:30.788759 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:30.796829 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8f06d912-b722-4069-82e2-900cc74476b1 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1358 microversion: 2.1 time: 0.152053 Sep 28 08:53:30.797421 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 544/1118] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:30 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:31.820639 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:31.821280 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:31.827784 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:31.828259 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:31.828692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:31.829416 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:31.829865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:31.830295 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:31.961700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:31.969353 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-60dc6936-c227-4b48-8bc2-4ba230bb6cc2 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1548 microversion: 2.1 time: 0.153165 Sep 28 08:53:31.969922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 575/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:31 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:31.991357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:31.991995 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:31.998419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:31.998923 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:31.999468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:32.000159 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:32.000605 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:32.001032 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:32.136636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:32.144405 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f52d2bc0-987a-4eda-b9d7-67c2f8c4ef40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1548 microversion: 2.1 time: 0.156990 Sep 28 08:53:32.144967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 545/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:31 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:53:32.166621 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:32.171764 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:32.172537 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Searching by: {'deleted': False, 'project_id': 'a5865848bafe480db52b92ab3323645f'} {{(pid=127111) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 28 08:53:32.179856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:32.180338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:32.180773 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:32.181535 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:32.182002 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:32.182431 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:32.272101 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.multi_cell_list [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127111) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 28 08:53:32.372505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ddf28450-823b-41cc-b90e-b1909169d786 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210079 Sep 28 08:53:32.373008 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 576/1121] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Sep 28 08:53:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:53:32.384555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:32.385232 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:32.391266 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:32.391767 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:32.392194 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:32.392899 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:32.393395 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:32.394681 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:32.523583 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:32.531572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-600c5e2f-382d-44e3-a1b3-2b92f5003cd3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1548 microversion: 2.1 time: 0.150827 Sep 28 08:53:32.532139 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 546/1122] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:32 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:34.083090 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f78f322-610d-4470-a0fd-1878b089bdc1"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:34.085936 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:34.092418 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:34.092908 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:34.093377 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:34.094068 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:34.094522 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:34.094951 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:34.376638 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dc51b288-d8be-4fab-a94d-e2b0b81498a5 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297292 Sep 28 08:53:34.377282 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 577/1123] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Sep 28 08:53:34 2022] POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:53:42.205563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:42.206263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:42.208794 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:42.214984 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:42.215466 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:42.215895 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:42.216585 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:42.217027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:42.217489 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:42.221915 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=67 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:42.359739 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:42.369441 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ae1dfdcf-1d60-48c8-9c73-4d0f6ad442e9 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1594 microversion: 2.1 time: 0.167738 Sep 28 08:53:42.370013 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 547/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:42 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:44.041547 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:44.046753 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-43484ad9-df29-4ebd-a07e-9e154034ae14 req-1c18bf93-5434-4861-bc96-fadc199bd373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575ed4ff-93ec-4e2a-882e-ef9c582c0ee2", "tag": "46130deb-f05d-45a3-9209-b6a24b906549"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:44.053474 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:44.058069 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-43484ad9-df29-4ebd-a07e-9e154034ae14 req-1c18bf93-5434-4861-bc96-fadc199bd373 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:44.058557 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-43484ad9-df29-4ebd-a07e-9e154034ae14 req-1c18bf93-5434-4861-bc96-fadc199bd373 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:44.058993 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-43484ad9-df29-4ebd-a07e-9e154034ae14 req-1c18bf93-5434-4861-bc96-fadc199bd373 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:44.063682 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:53:44.073257 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-43484ad9-df29-4ebd-a07e-9e154034ae14 req-1c18bf93-5434-4861-bc96-fadc199bd373 service nova] Creating event network-changed:46130deb-f05d-45a3-9209-b6a24b906549 for instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 on hv-cinder-84456 Sep 28 08:53:44.079121 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-43484ad9-df29-4ebd-a07e-9e154034ae14 req-1c18bf93-5434-4861-bc96-fadc199bd373 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038811 Sep 28 08:53:44.079789 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 578/1125] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:53:45.502319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1490180461"}} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:45.502873 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:45.509786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:45.510273 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:45.510702 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:45.511386 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:45.511832 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:45.512256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:45.654529 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.network.security_group_api [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Adding security group 96e98c79-1180-4745-b3c4-4e8219af4d2f to port 46130deb-f05d-45a3-9209-b6a24b906549 Sep 28 08:53:45.981216 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3edccc27-1c1b-402b-8769-8d5656fdd486 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/action" status: 202 len: 0 microversion: 2.1 time: 0.482147 Sep 28 08:53:45.982183 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 548/1126] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:53:45 2022] POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:53:45.992025 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:45.992842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:45.999610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:46.000102 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:46.000536 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:46.001275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:46.001732 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:46.002177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:46.065893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-74f328fd-488f-4205-b651-daf4621b1e95 req-ee92588b-2b53-4434-b1d6-4ae5b8ed6e95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575ed4ff-93ec-4e2a-882e-ef9c582c0ee2", "tag": "46130deb-f05d-45a3-9209-b6a24b906549"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:46.076284 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-74f328fd-488f-4205-b651-daf4621b1e95 req-ee92588b-2b53-4434-b1d6-4ae5b8ed6e95 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:46.076769 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-74f328fd-488f-4205-b651-daf4621b1e95 req-ee92588b-2b53-4434-b1d6-4ae5b8ed6e95 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:46.077227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-74f328fd-488f-4205-b651-daf4621b1e95 req-ee92588b-2b53-4434-b1d6-4ae5b8ed6e95 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:46.090072 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-74f328fd-488f-4205-b651-daf4621b1e95 req-ee92588b-2b53-4434-b1d6-4ae5b8ed6e95 service nova] Creating event network-changed:46130deb-f05d-45a3-9209-b6a24b906549 for instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 on hv-cinder-84456 Sep 28 08:53:46.095699 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-74f328fd-488f-4205-b651-daf4621b1e95 req-ee92588b-2b53-4434-b1d6-4ae5b8ed6e95 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105036 Sep 28 08:53:46.096379 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 549/1127] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:53:46.168510 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:46.178451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-53ac6a9e-db6b-4e97-a658-4b05a4ec3f98 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1760 microversion: 2.1 time: 0.191541 Sep 28 08:53:46.179428 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 579/1128] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:45 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1760 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:48.091168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:48.091716 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:48.098259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:48.099528 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:48.099975 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:48.100676 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:48.101161 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:48.101589 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:48.127033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:53:48.213119 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1bf9e090-e9de-4de8-8fb8-7e4a2b4e6026 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "DELETE /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 204 len: 0 microversion: 2.1 time: 0.125892 Sep 28 08:53:48.213971 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 550/1129] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:53:48 2022] DELETE /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:53:48.222293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:48.222913 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:48.230057 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:48.230542 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:48.230978 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:48.231678 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:48.232131 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:48.232558 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:48.384626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:48.392352 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-61e6fd50-6e4f-4bc7-af70-a234ca2718cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1577 microversion: 2.1 time: 0.173987 Sep 28 08:53:48.392908 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 580/1130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:48 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:49.416643 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:49.417363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:49.424090 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:49.424620 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:49.425019 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:49.425830 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:49.426289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:49.426719 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:49.557728 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:49.565503 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3c87fa3f-18f8-48fb-b9ca-25a7fdfc48a9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1577 microversion: 2.1 time: 0.153242 Sep 28 08:53:49.566068 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 551/1131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:49 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:50.590026 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:50.590804 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:50.597082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:50.597606 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:50.598036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:50.599308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:50.599754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:50.600171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:50.688997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:50.698196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-78ab7024-b981-4dfc-a63b-9de95a14c3de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1509 microversion: 2.1 time: 0.112016 Sep 28 08:53:50.699026 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 581/1132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:50 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1509 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:50.945070 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-b78617f1-49a2-4913-a910-4adee740fec1 req-3be8eabd-d5ca-413d-b85d-13a8c39c0dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71898013-5f2c-4fe1-95e5-ca068eece196", "name": "network-vif-deleted", "tag": "a42d676a-2b05-4f5e-b0d3-1587e3c2e587"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:50.955961 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b78617f1-49a2-4913-a910-4adee740fec1 req-3be8eabd-d5ca-413d-b85d-13a8c39c0dd3 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:50.956439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b78617f1-49a2-4913-a910-4adee740fec1 req-3be8eabd-d5ca-413d-b85d-13a8c39c0dd3 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:50.956870 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-b78617f1-49a2-4913-a910-4adee740fec1 req-3be8eabd-d5ca-413d-b85d-13a8c39c0dd3 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:50.969746 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-b78617f1-49a2-4913-a910-4adee740fec1 req-3be8eabd-d5ca-413d-b85d-13a8c39c0dd3 service nova] Creating event network-vif-deleted:a42d676a-2b05-4f5e-b0d3-1587e3c2e587 for instance 71898013-5f2c-4fe1-95e5-ca068eece196 on hv-cinder-84456 Sep 28 08:53:50.978789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-b78617f1-49a2-4913-a910-4adee740fec1 req-3be8eabd-d5ca-413d-b85d-13a8c39c0dd3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038543 Sep 28 08:53:50.979431 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 552/1133] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:53:51.722643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:51.723286 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:51.731211 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:51.731696 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:51.732132 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:51.732834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:51.733370 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:51.733836 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:51.772188 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:51.772668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:51.773201 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:51.773566 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lazy-loading 'fault' on Instance uuid 71898013-5f2c-4fe1-95e5-ca068eece196 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:53:51.826791 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:51.836168 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-343afafd-4e96-4b70-8765-b24d45c11dc5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 200 len: 1230 microversion: 2.1 time: 0.117336 Sep 28 08:53:51.836935 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 582/1134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:51 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 1230 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:52.861454 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:52.862071 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:52.868176 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:52.868657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:52.869110 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:52.869802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:52.870251 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:52.870675 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:52.884003 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] HTTP exception thrown: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Request method failure captured: Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 HTTP/1.1 Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNArPya-LCUrgz4WB6zeWIABWOUmZdZYJyKT2DW-JW4cycNSG1CVxC1TlVpjqeIrs7w1K35Y1ShAVmUm1rXr8YL6j87Rv2OQdnKN9K2qSTW3l-nMQJgHsDfJ6bUvJL5-e5_VafL_--hOISt7tJT3CS8F7bl6Q_6deXA_D5GirDayepMA Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:53:52.885665 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba777b9726e944a881c0953e605f7477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba777b9726e944a881c0953e605f7477", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: e4ecba03d9254112b343f36ade20754f Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:53:52.887277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '71898013-5f2c-4fe1-95e5-ca068eece196'} Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:53:52.888260 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:53:52.890206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:53:52.891735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Returning 404 to user: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:53:52.891735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f5e2f5bc-fa95-4f5d-b70c-2163e9663603 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 404 len: 111 microversion: 2.1 time: 0.030782 Sep 28 08:53:52.891735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 553/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:52 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:53:53.047675 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1447356916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-215678673", "security_groups": [{"name": "tempest-secgroup-smoke-1169161800"}], "block_device_mapping_v2": [{"uuid": "2d211cf0-3f3b-4ac8-9ba5-b3ce9dd74bd1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "411ef26c-758f-4425-9392-e141db9ca352"}]}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:53.161983 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] validate_networks() for [('411ef26c-758f-4425-9392-e141db9ca352', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:53:53.530612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:53:53.531041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:53:53.531575 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:53:53.531986 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:53:53.532400 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:53:53.541697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:53.542177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:53.542866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:53.543586 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:53.544043 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:53.544465 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:53.560591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for project ba777b9726e944a881c0953e605f7477. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:53:53.564513 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for user e4ecba03d9254112b343f36ade20754f and project ba777b9726e944a881c0953e605f7477. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:53:53.622958 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:53:53.625144 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d211cf0-3f3b-4ac8-9ba5-b3ce9dd74bd1',volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:53:53.774357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-82264687-e185-4b81-9a7c-5ffa47552be9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731586 Sep 28 08:53:53.775019 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 583/1136] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:53:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 28 08:53:53.786103 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a12ad269-d606-4029-843f-c9de96962830 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:53.786712 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a12ad269-d606-4029-843f-c9de96962830 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:53.840842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a12ad269-d606-4029-843f-c9de96962830 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:53.847822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a12ad269-d606-4029-843f-c9de96962830 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1094 microversion: 2.1 time: 0.065541 Sep 28 08:53:53.848435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 554/1137] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:53 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:53:54.870904 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:54.872129 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:54.878754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:54.879240 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:54.879678 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:54.880378 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:54.880830 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:54.881284 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:54.956094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:54.965412 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-525092ff-8658-4b1c-8297-b175375b020f tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1200 microversion: 2.1 time: 0.098643 Sep 28 08:53:54.966194 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 584/1138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:54 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:55.998381 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:55.999011 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:56.006795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:56.007350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:56.007859 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:56.008635 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:56.009217 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:56.009715 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:56.153436 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:56.161343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9637c6fd-f3f0-4d7f-8d34-b081fce27ba9 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.166873 Sep 28 08:53:56.161924 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 555/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:55 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:53:56.361340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-e43021e7-2547-4e9a-8c75-28a84273fa90 req-ac853d27-ec8c-4fcc-89ca-e8111a03d6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee37495f-3dd5-465d-bbc6-d65a573b6e84", "tag": "7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:53:56.373227 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-e43021e7-2547-4e9a-8c75-28a84273fa90 req-ac853d27-ec8c-4fcc-89ca-e8111a03d6f8 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:56.373873 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-e43021e7-2547-4e9a-8c75-28a84273fa90 req-ac853d27-ec8c-4fcc-89ca-e8111a03d6f8 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:56.374636 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-e43021e7-2547-4e9a-8c75-28a84273fa90 req-ac853d27-ec8c-4fcc-89ca-e8111a03d6f8 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:56.387379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-e43021e7-2547-4e9a-8c75-28a84273fa90 req-ac853d27-ec8c-4fcc-89ca-e8111a03d6f8 service nova] Creating event network-changed:7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760 for instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 on hv-cinder-84456 Sep 28 08:53:56.394113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-e43021e7-2547-4e9a-8c75-28a84273fa90 req-ac853d27-ec8c-4fcc-89ca-e8111a03d6f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038786 Sep 28 08:53:56.394988 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 585/1140] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:53:57.184646 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:57.185235 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:57.191625 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:57.192786 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:57.193241 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:57.193928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:57.194374 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:57.194792 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:57.323954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:57.331544 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-20e30e0b-9a86-4129-a599-30d5afb294d2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.150888 Sep 28 08:53:57.332101 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 556/1141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:57 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:53:58.355296 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:58.355921 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:58.362117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:58.362600 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:58.363038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:58.363740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:58.364197 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:58.364631 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:58.498273 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:58.506380 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fab8e22e-3120-4aae-a668-dab841795f89 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.155863 Sep 28 08:53:58.506936 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 586/1142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:58 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:53:59.529657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:53:59.530287 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:53:59.537579 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:59.538077 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:59.538514 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:59.539226 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:53:59.539672 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:53:59.540099 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:53:59.680751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:53:59.689301 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-97ded38e-5aeb-4ef7-b10b-dbaa3a028ff0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.163700 Sep 28 08:53:59.689869 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 557/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:53:59 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:00.713622 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:00.714446 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:00.721072 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:00.721591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:00.722038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:00.722740 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:00.723738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:00.724166 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:00.868102 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:00.876038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-39520703-49e2-452a-9a1c-942ae1ac02d1 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.166439 Sep 28 08:54:00.876612 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 587/1144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:00 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:54:01.899592 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:01.900211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:01.906842 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:01.907402 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:01.907847 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:01.908546 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:01.909004 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:01.909455 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:02.046748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:02.055211 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e1f251b1-abcd-4832-8205-c5f78ca4d9e5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.159530 Sep 28 08:54:02.055782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 558/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:01 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:03.077774 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:03.078372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:03.085415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:03.085899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:03.086331 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:03.087021 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:03.087469 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:03.087892 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:03.217947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:03.226462 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c7cc213d-00e6-4dac-b9ff-718d29f59dbe tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.152487 Sep 28 08:54:03.227034 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 588/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:03 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:04.249916 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:04.250586 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:04.253053 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:04.258939 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:04.259429 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:04.259867 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:04.260571 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:04.261027 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:04.261484 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:04.409901 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:04.418488 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-de375b7d-4cd1-42ce-9372-b24db85eb8f0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.172473 Sep 28 08:54:04.419107 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 559/1147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:04 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:05.445003 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:05.445983 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:05.448811 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:05.449785 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:05.459077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:05.459641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:05.460293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:05.461389 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:05.462082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:05.462724 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:05.598449 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:05.610109 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-6baa7114-6f89-4784-acd6-cba3e04b865c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.171217 Sep 28 08:54:05.610691 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 589/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:05 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:06.633122 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:06.633922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:06.640197 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:06.640683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:06.641145 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:06.641852 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:06.642306 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:06.642735 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:06.786073 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:06.794954 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e0957141-3be3-4af5-bbb2-47571bf2275c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.165706 Sep 28 08:54:06.795519 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 560/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:06 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:07.568847 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-8f37e2e5-e01e-423c-a172-5aecb39260e6 req-ed3047b3-b43b-4526-88b2-cbc67db8bf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee37495f-3dd5-465d-bbc6-d65a573b6e84", "name": "network-vif-plugged", "status": "completed", "tag": "7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:54:07.580330 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-8f37e2e5-e01e-423c-a172-5aecb39260e6 req-ed3047b3-b43b-4526-88b2-cbc67db8bf6c service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:07.580822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-8f37e2e5-e01e-423c-a172-5aecb39260e6 req-ed3047b3-b43b-4526-88b2-cbc67db8bf6c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:07.581307 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-8f37e2e5-e01e-423c-a172-5aecb39260e6 req-ed3047b3-b43b-4526-88b2-cbc67db8bf6c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:07.596291 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-8f37e2e5-e01e-423c-a172-5aecb39260e6 req-ed3047b3-b43b-4526-88b2-cbc67db8bf6c service nova] Creating event network-vif-plugged:7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760 for instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 on hv-cinder-84456 Sep 28 08:54:07.602094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-8f37e2e5-e01e-423c-a172-5aecb39260e6 req-ed3047b3-b43b-4526-88b2-cbc67db8bf6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037540 Sep 28 08:54:07.602701 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 590/1150] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:54:07.816782 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:07.817458 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:07.824108 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:07.824596 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:07.825033 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:07.825757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:07.826207 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:07.826632 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:07.959419 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:07.967038 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-754ce4db-b96c-48eb-8c58-e819e87bf59b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.154127 Sep 28 08:54:07.967616 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 561/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:07 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:08.991368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:08.992098 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:08.998269 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:08.998748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:08.999185 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:08.999870 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:09.000321 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:09.000750 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:09.133549 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:09.141440 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ea0cdcd0-566f-4dee-9f20-2450c3e5606d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1266 microversion: 2.1 time: 0.155843 Sep 28 08:54:09.142007 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 591/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:08 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:54:10.165413 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:10.165975 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:10.172737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:10.173262 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:10.173704 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:10.174408 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:10.174861 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:10.175286 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:10.313037 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:10.320734 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0c1ff38e-cfdf-4277-8fb8-65b18c451878 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1453 microversion: 2.1 time: 0.160094 Sep 28 08:54:10.321319 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 562/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:10 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:10.343421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:10.344036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:10.351039 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:10.351538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:10.351974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:10.352668 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:10.353158 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:10.353592 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:10.480853 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:10.488584 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c6091bd2-f8d5-4974-9a7c-cfbc1f60c8de tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1453 microversion: 2.1 time: 0.149056 Sep 28 08:54:10.489292 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 592/1154] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:10 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:54:12.368933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-381ba534-3328-4d73-af15-cdf4d2003a22 req-160134e8-f058-4059-a5d7-e4da4507714b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee37495f-3dd5-465d-bbc6-d65a573b6e84", "tag": "7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:54:12.374342 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:12.380470 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-381ba534-3328-4d73-af15-cdf4d2003a22 req-160134e8-f058-4059-a5d7-e4da4507714b service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:12.381015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-381ba534-3328-4d73-af15-cdf4d2003a22 req-160134e8-f058-4059-a5d7-e4da4507714b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:12.381532 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-381ba534-3328-4d73-af15-cdf4d2003a22 req-160134e8-f058-4059-a5d7-e4da4507714b service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:12.385882 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:12.394040 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-381ba534-3328-4d73-af15-cdf4d2003a22 req-160134e8-f058-4059-a5d7-e4da4507714b service nova] Creating event network-changed:7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760 for instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 on hv-cinder-84456 Sep 28 08:54:12.400315 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-381ba534-3328-4d73-af15-cdf4d2003a22 req-160134e8-f058-4059-a5d7-e4da4507714b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034993 Sep 28 08:54:12.401023 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 563/1155] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:54:46.712117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:54:46.714748 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:46.716888 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:46.717571 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=75 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:46.724478 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:46.725643 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:46.726077 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:46.726778 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:46.727235 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:46.727665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:46.798379 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d230e08a-7afe-4b32-9ae9-0ebc0d7d64c8 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/action" status: 202 len: 0 microversion: 2.1 time: 0.090635 Sep 28 08:54:46.800205 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 593/1156] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:54:46 2022] POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:54:46.807000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:54:46.812018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:46.812937 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:46.823427 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:46.823917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:46.824365 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:46.825055 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:46.825532 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:46.825953 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:46.973180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:46.982206 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ce6c2c99-aac2-4302-becb-4e9dd0898163 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1752 microversion: 2.1 time: 0.177349 Sep 28 08:54:46.982784 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 564/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:46 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:48.008182 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:48.008878 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:48.015041 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:48.015528 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:48.015962 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:48.016695 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:48.017116 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:48.017536 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:48.169268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:48.177396 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9bba377e-a57f-4466-b9dc-1deab0a9ce39 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.174084 Sep 28 08:54:48.178065 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 594/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:48 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:49.201065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:49.201680 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:49.208054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:49.208534 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:49.209654 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:49.210349 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:49.210802 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:49.211226 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:49.352515 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:49.360628 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bd403215-2a56-461e-84d9-32de781a88e0 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.163509 Sep 28 08:54:49.361205 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 565/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:49 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:50.384598 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:50.385255 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:50.392245 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:50.392697 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:50.393149 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:50.393831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:50.394271 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:50.394693 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:50.543869 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:50.552022 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4f22118d-29e9-48bd-b3d7-d537989bea20 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.171277 Sep 28 08:54:50.552573 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 595/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:50 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:51.575289 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:51.575902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:51.578136 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 08:54:51.578280 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Wed Sep 28 08:54:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 (ip 10.222.0.52) !!! Sep 28 08:54:51.588170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:51.588656 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:51.589121 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:51.589825 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:51.590277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:51.590696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:51.732820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:51.742276 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-00a0e6a3-d25a-499f-9ac2-aa5750ea036f tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.170853 Sep 28 08:54:51.742841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 566/1161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:51 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:52.767641 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:52.769890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:52.778833 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:52.779252 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:52.779692 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:52.788594 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:52.789078 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:52.789527 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:52.932268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:52.940459 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-c71ab536-db33-45c7-8b2a-2ee6dd9dddc3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.176841 Sep 28 08:54:52.941051 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 596/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:52 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:53.964435 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:53.965075 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:53.971436 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:53.971935 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:53.972351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:53.973076 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:53.973552 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:53.974000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:54.112781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:54.121528 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-c3283497-db4b-42ed-a9f3-d0e512ed7869 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.160996 Sep 28 08:54:54.122103 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 567/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:53 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:55.145262 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:55.145879 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:55.152903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:55.153414 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:55.153855 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:55.154602 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:55.155036 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:55.155463 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:55.297479 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:55.306311 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-dfb5f84b-b634-45f1-972d-aece992141fd tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.164945 Sep 28 08:54:55.306865 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 597/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:55 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:56.329657 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:56.330270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:56.336730 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:56.337237 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:56.337672 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:56.338363 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:56.338814 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:56.339232 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:56.480795 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:56.488994 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-eb0099c8-2591-4277-9611-a76bc9a6d965 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.163332 Sep 28 08:54:56.489580 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 568/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:56 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:57.513228 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:57.513950 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:57.520480 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:57.520969 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:57.521433 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:57.522860 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:57.523319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:57.523741 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:57.663059 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:57.671394 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-9a3ae7fb-90d8-48d7-a08e-679bd84bbc2e tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1757 microversion: 2.1 time: 0.162116 Sep 28 08:54:57.671948 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 598/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:57 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:54:58.694426 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:54:58.695015 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:54:58.701291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:58.701772 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:58.702214 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:58.702902 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:54:58.703354 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:54:58.703781 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:54:58.852524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:54:58.861120 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d3a424c7-6679-4b7b-a7b0-fe4e1ff9f623 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1760 microversion: 2.1 time: 0.170623 Sep 28 08:54:58.861670 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 569/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:54:58 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:55:56.961576 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1490180461"}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:55:56.962157 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:55:56.964340 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=12 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:56.964997 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:56.970538 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:56.971012 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:56.971442 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:56.972117 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:56.972561 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:56.972976 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:57.098066 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.network.security_group_api [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Removing security group 96e98c79-1180-4745-b3c4-4e8219af4d2f from port 46130deb-f05d-45a3-9209-b6a24b906549 Sep 28 08:55:57.396198 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d67470c9-5c72-4335-bcce-5bac48bbd480 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/action" status: 202 len: 0 microversion: 2.1 time: 0.438525 Sep 28 08:55:57.396820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 599/1168] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Sep 28 08:55:56 2022] POST /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:55:57.414459 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-fcc9bdbb-4192-4286-8a2c-72c3d3dc6028 req-d9eee4a7-f866-4255-a3cc-c0b82339fa39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575ed4ff-93ec-4e2a-882e-ef9c582c0ee2", "tag": "46130deb-f05d-45a3-9209-b6a24b906549"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:55:57.420018 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=12 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:57.420818 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=37 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:55:57.426469 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-fcc9bdbb-4192-4286-8a2c-72c3d3dc6028 req-d9eee4a7-f866-4255-a3cc-c0b82339fa39 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:57.427054 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-fcc9bdbb-4192-4286-8a2c-72c3d3dc6028 req-d9eee4a7-f866-4255-a3cc-c0b82339fa39 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:57.427497 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-fcc9bdbb-4192-4286-8a2c-72c3d3dc6028 req-d9eee4a7-f866-4255-a3cc-c0b82339fa39 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:57.440439 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-fcc9bdbb-4192-4286-8a2c-72c3d3dc6028 req-d9eee4a7-f866-4255-a3cc-c0b82339fa39 service nova] Creating event network-changed:46130deb-f05d-45a3-9209-b6a24b906549 for instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 on hv-cinder-84456 Sep 28 08:55:57.445705 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-fcc9bdbb-4192-4286-8a2c-72c3d3dc6028 req-d9eee4a7-f866-4255-a3cc-c0b82339fa39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044055 Sep 28 08:55:57.446686 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 570/1169] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:55:58.471903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:55:58.472393 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:55:58.478444 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:58.478921 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:58.479348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:58.480024 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:58.480495 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:58.480915 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:58.561248 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.objects.instance [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lazy-loading 'services' on Instance uuid 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 {{(pid=127111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 28 08:55:58.635642 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-62a4e323-a964-4ea2-b468-c9a88ac08c70 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "DELETE /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments/7f78f322-610d-4470-a0fd-1878b089bdc1" status: 202 len: 0 microversion: 2.1 time: 0.168107 Sep 28 08:55:58.636421 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 600/1170] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:55:58 2022] DELETE /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments/7f78f322-610d-4470-a0fd-1878b089bdc1 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:55:58.645673 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:55:58.648061 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:55:58.655170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:58.655922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:58.656610 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:58.657105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:58.657563 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:58.658361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:58.688131 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-fef9143d-4ff4-4f76-a87d-145384266d40 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047231 Sep 28 08:55:58.688893 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 571/1171] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:55:58 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:55:59.464246 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-5fe98287-bd4d-4e36-b15d-dd97d0196ce2 req-6ab9a3f9-3f34-4b82-94f4-f6c2b9a2ef19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575ed4ff-93ec-4e2a-882e-ef9c582c0ee2", "tag": "46130deb-f05d-45a3-9209-b6a24b906549"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:55:59.475529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-5fe98287-bd4d-4e36-b15d-dd97d0196ce2 req-6ab9a3f9-3f34-4b82-94f4-f6c2b9a2ef19 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:59.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-5fe98287-bd4d-4e36-b15d-dd97d0196ce2 req-6ab9a3f9-3f34-4b82-94f4-f6c2b9a2ef19 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:59.476425 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-5fe98287-bd4d-4e36-b15d-dd97d0196ce2 req-6ab9a3f9-3f34-4b82-94f4-f6c2b9a2ef19 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:59.490324 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-5fe98287-bd4d-4e36-b15d-dd97d0196ce2 req-6ab9a3f9-3f34-4b82-94f4-f6c2b9a2ef19 service nova] Creating event network-changed:46130deb-f05d-45a3-9209-b6a24b906549 for instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 on hv-cinder-84456 Sep 28 08:55:59.495011 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-5fe98287-bd4d-4e36-b15d-dd97d0196ce2 req-6ab9a3f9-3f34-4b82-94f4-f6c2b9a2ef19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035791 Sep 28 08:55:59.495694 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 601/1172] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:55:59.701036 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:55:59.703626 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:55:59.711089 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:59.711611 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:59.712088 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:59.712820 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:59.713472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:59.714071 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:59.743013 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3daa5bd0-d67a-4bb0-aa93-147343c708e4 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045934 Sep 28 08:55:59.743764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 572/1173] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Sep 28 08:55:59 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 28 08:55:59.754998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:55:59.755617 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:55:59.762240 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:59.762728 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:59.763171 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:59.763871 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:55:59.764328 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:55:59.764749 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:55:59.840813 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] HTTP exception thrown: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 is not attached to volume 7f78f322-610d-4470-a0fd-1878b089bdc1 Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Request method failure captured: Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments/7f78f322-610d-4470-a0fd-1878b089bdc1 HTTP/1.1 Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAtnO2A0ntD8D6-sm_J7HzqecNKOHBIjdjuPGhBZ6nV8misf3NAuogqasNFAGEhxICLkraI1hbVlBhGd5IQ59c4E_3OdgbEXXG0uAjcqK7UqTAuxPmjT_I12nxZCLfQJeYD49SsGKsSHcta2acj69DpMmZ_Im4At9N2KK80gZZm0gjc Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: a5865848bafe480db52b92ab3323645f Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-TestMinimumBasicScenario-1993402050 Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:55:59.843212 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5865848bafe480db52b92ab3323645f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5865848bafe480db52b92ab3323645f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5865848bafe480db52b92ab3323645f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5865848bafe480db52b92ab3323645f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-TestMinimumBasicScenario-1993402050 Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: a5865848bafe480db52b92ab3323645f Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1993402050 Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-TestMinimumBasicScenario-1993402050-project Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7a41fc47ed5447af88710dd6e74523ce Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-TestMinimumBasicScenario-1993402050-project Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:55:59.844979 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 is not attached to volume 7f78f322-610d-4470-a0fd-1878b089bdc1 Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'server_id': '575ed4ff-93ec-4e2a-882e-ef9c582c0ee2', 'id': '7f78f322-610d-4470-a0fd-1878b089bdc1'} Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7f78f322-610d-4470-a0fd-1878b089bdc1. Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:55:59.845991 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 is not attached to volume 7f78f322-610d-4470-a0fd-1878b089bdc1 Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 is not attached to volume 7f78f322-610d-4470-a0fd-1878b089bdc1 Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:55:59.847610 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Returning 404 to user: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 is not attached to volume 7f78f322-610d-4470-a0fd-1878b089bdc1 {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:55:59.848938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7b16bd1f-9a73-46bb-b3c2-0b8aaecafbf3 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "DELETE /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments/7f78f322-610d-4470-a0fd-1878b089bdc1" status: 404 len: 154 microversion: 2.1 time: 0.094316 Sep 28 08:55:59.848938 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 602/1174] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Sep 28 08:55:59 2022] DELETE /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2/os-volume_attachments/7f78f322-610d-4470-a0fd-1878b089bdc1 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:56:00.983109 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:00.983600 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:00.989936 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:00.990450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:00.990888 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:00.991572 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:00.992030 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:00.992451 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:01.017065 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:56:01.095855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-33727073-c5a5-4854-a539-7e1f4cf8b4ee tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "DELETE /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 204 len: 0 microversion: 2.1 time: 0.116237 Sep 28 08:56:01.096524 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 573/1175] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:56:00 2022] DELETE /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:56:01.105739 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:01.106767 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:01.114357 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:01.114835 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:01.115288 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:01.115995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:01.116441 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:01.116862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:01.248793 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:01.257290 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-aac206ce-29c6-450b-92d1-2a59f4a0156b tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1554 microversion: 2.1 time: 0.156252 Sep 28 08:56:01.257845 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 603/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:01 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:02.282560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:02.283272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:02.290173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:02.290658 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:02.291094 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:02.292052 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:02.292502 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:02.292927 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:02.433279 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:02.440875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-0c90018f-f581-44e1-9adf-ba52e616f679 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1554 microversion: 2.1 time: 0.162690 Sep 28 08:56:02.441473 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 574/1177] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:02 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:03.464114 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:03.464862 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:03.471777 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:03.472274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:03.472713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:03.473464 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:03.473899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:03.474325 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:03.622219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a41fc47ed5447af88710dd6e74523ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5865848bafe480db52b92ab3323645f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:03.629899 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-3940894e-dbc6-4738-a000-5fd3a5e27c8d tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 200 len: 1554 microversion: 2.1 time: 0.169882 Sep 28 08:56:03.630461 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 604/1178] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:03 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:03.926450 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-9c196dab-ec0f-4dcd-b11d-2c7bee49abb1 req-12b908ea-5b55-42b8-b6e6-2e4cc688cd8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575ed4ff-93ec-4e2a-882e-ef9c582c0ee2", "name": "network-vif-deleted", "tag": "46130deb-f05d-45a3-9209-b6a24b906549"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:56:03.935764 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-9c196dab-ec0f-4dcd-b11d-2c7bee49abb1 req-12b908ea-5b55-42b8-b6e6-2e4cc688cd8c service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:03.936256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-9c196dab-ec0f-4dcd-b11d-2c7bee49abb1 req-12b908ea-5b55-42b8-b6e6-2e4cc688cd8c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:03.936679 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-9c196dab-ec0f-4dcd-b11d-2c7bee49abb1 req-12b908ea-5b55-42b8-b6e6-2e4cc688cd8c service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:03.947457 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-9c196dab-ec0f-4dcd-b11d-2c7bee49abb1 req-12b908ea-5b55-42b8-b6e6-2e4cc688cd8c service nova] Creating event network-vif-deleted:46130deb-f05d-45a3-9209-b6a24b906549 for instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 on hv-cinder-84456 Sep 28 08:56:03.952443 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-9c196dab-ec0f-4dcd-b11d-2c7bee49abb1 req-12b908ea-5b55-42b8-b6e6-2e4cc688cd8c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144581 Sep 28 08:56:03.953051 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 575/1179] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:56:04.652787 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:04.653350 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] [instance: 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:04.659630 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:04.660112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:04.660547 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:04.661274 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:04.661733 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:04.662156 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:04.675299 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] HTTP exception thrown: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 could not be found. Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Request method failure captured: Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 HTTP/1.1 Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNAtnO2A0ntD8D6-sm_J7HzqecNKOHBIjdjuPGhBZ6nV8misf3NAuogqasNFAGEhxICLkraI1hbVlBhGd5IQ59c4E_3OdgbEXXG0uAjcqK7UqTAuxPmjT_I12nxZCLfQJeYD49SsGKsSHcta2acj69DpMmZ_Im4At9N2KK80gZZm0gjc Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: a5865848bafe480db52b92ab3323645f Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-TestMinimumBasicScenario-1993402050 Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:56:04.676827 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5865848bafe480db52b92ab3323645f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5865848bafe480db52b92ab3323645f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5865848bafe480db52b92ab3323645f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5865848bafe480db52b92ab3323645f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-TestMinimumBasicScenario-1993402050 Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: a5865848bafe480db52b92ab3323645f Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1993402050 Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-TestMinimumBasicScenario-1993402050-project Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: 7a41fc47ed5447af88710dd6e74523ce Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-TestMinimumBasicScenario-1993402050-project Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 could not be found. Sep 28 08:56:04.679094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '575ed4ff-93ec-4e2a-882e-ef9c582c0ee2'} Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 could not be found. Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:56:04.680094 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 could not be found. Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 could not be found. Sep 28 08:56:04.681734 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:56:04.683294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Returning 404 to user: Instance 575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:56:04.683294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-52149290-3946-45f7-b4e8-da3f0adcdd63 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2" status: 404 len: 111 microversion: 2.1 time: 0.029911 Sep 28 08:56:04.683294 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 605/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:04 2022] GET /compute/v2.1/servers/575ed4ff-93ec-4e2a-882e-ef9c582c0ee2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:56:04.687909 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1b29326b-2576-44cc-917c-c16c940c6740 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] Calling method '.version_select at 0x7f984fdd8160>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:04.710921 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1b29326b-2576-44cc-917c-c16c940c6740 tempest-TestMinimumBasicScenario-1993402050 tempest-TestMinimumBasicScenario-1993402050-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1043301925" status: 202 len: 0 microversion: 2.1 time: 0.027107 Sep 28 08:56:04.711480 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 576/1181] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Sep 28 08:56:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1043301925 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 28 08:56:22.168172 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-362053198", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-215678673", "security_groups": [{"name": "tempest-secgroup-smoke-1169161800"}], "block_device_mapping_v2": [{"uuid": "f502f6d3-df9b-4e5a-8268-faf559290317", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "411ef26c-758f-4425-9392-e141db9ca352"}]}} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:56:22.178772 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=14 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:22.179435 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:22.292062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.network.neutron [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] validate_networks() for [('411ef26c-758f-4425-9392-e141db9ca352', None, None, None, None, None)] {{(pid=127111) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 28 08:56:22.745388 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Flavor limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 28 08:56:22.745821 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Image limits 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 28 08:56:22.746298 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Flavor pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 28 08:56:22.746738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Image pref 0:0:0 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 28 08:56:22.747152 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.virt.hardware [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 28 08:56:22.756875 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:22.757383 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:22.757822 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:22.758545 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:22.759000 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:22.759427 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:22.776023 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for project ba777b9726e944a881c0953e605f7477. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 28 08:56:22.781665 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.quota [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Getting quotas for user e4ecba03d9254112b343f36ade20754f and project ba777b9726e944a881c0953e605f7477. Resources: {'ram', 'cores', 'instances'} {{(pid=127111) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 28 08:56:22.840776 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Going to run 1 instances... {{(pid=127111) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 28 08:56:22.842988 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f502f6d3-df9b-4e5a-8268-faf559290317',volume_size=None,volume_type=None)] {{(pid=127111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 28 08:56:22.968270 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [cdcc8d9b-53db-43ac-837a-634e6811f27b] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 08:56:23.976012 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO oslo.messaging._drivers.impl_rabbit [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [cdcc8d9b-53db-43ac-837a-634e6811f27b] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58364. Sep 28 08:56:23.980207 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1304c4c4-add3-414a-8a71-e112c8b71281 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.816429 Sep 28 08:56:23.980848 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 606/1182] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Sep 28 08:56:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 28 08:56:23.990142 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:23.990886 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:23.994757 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-8c2e69ee-8cd7-4589-a3f5-c14101ff77a2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:23.995485 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-8c2e69ee-8cd7-4589-a3f5-c14101ff77a2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:24.056708 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-8c2e69ee-8cd7-4589-a3f5-c14101ff77a2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:24.064510 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-8c2e69ee-8cd7-4589-a3f5-c14101ff77a2 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1093 microversion: 2.1 time: 0.076334 Sep 28 08:56:24.065548 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 577/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:23 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:25.088671 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:25.089338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:25.095382 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:25.095866 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:25.096300 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:25.096990 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:25.097529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:25.097955 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:25.159897 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:25.170798 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-19e4ade8-4c7b-427c-82d1-4965c79d5f7d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1199 microversion: 2.1 time: 0.087204 Sep 28 08:56:25.171633 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 607/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:25 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:56:26.195951 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:26.196516 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:26.203075 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:26.203562 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:26.204001 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:26.204706 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:26.205187 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:26.205622 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:26.340227 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:26.348278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-a658303f-2002-4ef6-8f8d-13358fd2706b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.156288 Sep 28 08:56:26.349751 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 578/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:26 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:26.524924 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-dde7ab9a-0387-4a12-b910-3683b89d750d req-60e00546-203b-40d5-9319-f808b195a475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dbd7df-d98c-4eb4-a0cd-c2be66607c84", "tag": "c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:56:26.536219 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-dde7ab9a-0387-4a12-b910-3683b89d750d req-60e00546-203b-40d5-9319-f808b195a475 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:26.536702 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-dde7ab9a-0387-4a12-b910-3683b89d750d req-60e00546-203b-40d5-9319-f808b195a475 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:26.537167 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-dde7ab9a-0387-4a12-b910-3683b89d750d req-60e00546-203b-40d5-9319-f808b195a475 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:26.548334 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-dde7ab9a-0387-4a12-b910-3683b89d750d req-60e00546-203b-40d5-9319-f808b195a475 service nova] Creating event network-changed:c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5 for instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 on hv-cinder-84456 Sep 28 08:56:26.553260 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-dde7ab9a-0387-4a12-b910-3683b89d750d req-60e00546-203b-40d5-9319-f808b195a475 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033362 Sep 28 08:56:26.553842 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 608/1186] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:56:27.371997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:27.372617 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:27.379057 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:27.379536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:27.379967 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:27.380655 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:27.381115 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:27.381555 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:27.511722 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:27.519361 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-e525aba9-3548-4ae7-953a-8469b3311ed8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.151686 Sep 28 08:56:27.519925 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 579/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:27 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:28.542473 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:28.543177 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:28.549301 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:28.549783 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:28.550223 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:28.550974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:28.551429 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:28.552348 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:28.680700 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:28.688393 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7ff29044-7cc9-4a60-b8d7-a0a2b3a943b6 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.150823 Sep 28 08:56:28.688962 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 609/1188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:28 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:29.712287 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:29.712868 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:29.718906 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:29.719380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:29.719808 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:29.720490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:29.720933 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:29.721380 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:29.851558 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:29.859127 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-1371574d-1aad-499c-9c34-11ffd615a54c tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.151387 Sep 28 08:56:29.859683 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 580/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:29 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:30.881505 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:30.882038 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:30.884493 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 08:56:30.884630 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Wed Sep 28 08:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 (ip 10.222.0.52) !!! Sep 28 08:56:30.891163 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:30.891636 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:30.892063 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:30.892744 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:30.893214 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:30.893635 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:31.025134 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:31.032593 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4c674ba0-2164-47c5-9a6f-4f685f2dec96 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.155011 Sep 28 08:56:31.033166 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 610/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:30 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:32.055333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:32.056050 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:32.058430 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 28 08:56:32.058560 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Wed Sep 28 08:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 (ip 10.222.0.52) !!! Sep 28 08:56:32.070281 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:32.070761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:32.071191 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:32.071875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:32.072326 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:32.072747 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:32.199270 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:32.206827 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-3171b67a-030b-4077-8f4e-6797e3352069 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.155422 Sep 28 08:56:32.207385 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 581/1191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:32 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:33.231974 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:33.232582 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:33.234867 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=2 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:33.235518 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell0:SELECT=6 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:33.241723 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:33.242196 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:33.242625 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:33.243310 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:33.243754 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:33.244200 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:33.376998 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:33.384952 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-1b02185c-a330-4f1c-8d8e-924a77f79b12 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.156843 Sep 28 08:56:33.385530 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 611/1192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:33 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:34.408179 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:34.408788 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:34.411168 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell0:SELECT=2 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:56:34.417698 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:34.418171 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:34.418694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:34.419309 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:34.420028 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:34.420506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:34.552587 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:34.560130 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-bc0ccad7-041f-477b-bb9e-d54e1da45a9a tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.155863 Sep 28 08:56:34.560693 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 582/1193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:34 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:35.582708 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:35.583353 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:35.589794 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:35.590275 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:35.590713 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:35.591409 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:35.591863 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:35.592289 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:35.730731 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:35.738384 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-ce686d5d-0045-4580-a8e3-731dc8afa75e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.159608 Sep 28 08:56:35.738945 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 612/1194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:35 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:36.762890 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:36.763496 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:36.769862 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:36.770344 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:36.770777 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:36.771467 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:36.771917 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:36.772337 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:36.900043 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:36.907639 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-900747f6-f4a3-4d65-a0c2-6a4f13924bd5 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.148660 Sep 28 08:56:36.908427 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 583/1195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:36 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:37.929885 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:37.930494 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:37.936890 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:37.937406 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:37.937864 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:37.938545 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:37.938994 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:37.939415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:38.065738 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:38.073858 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-fcd49b41-513a-4f8e-b805-66c11142c277 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.147865 Sep 28 08:56:38.074418 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 613/1196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:37 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:38.462798 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-81adf44a-d350-4173-9b02-ed7999f5adeb req-e9f7f3ec-78de-41b6-b777-16e8e0366461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dbd7df-d98c-4eb4-a0cd-c2be66607c84", "name": "network-vif-plugged", "status": "completed", "tag": "c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:56:38.472278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-81adf44a-d350-4173-9b02-ed7999f5adeb req-e9f7f3ec-78de-41b6-b777-16e8e0366461 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:38.472758 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-81adf44a-d350-4173-9b02-ed7999f5adeb req-e9f7f3ec-78de-41b6-b777-16e8e0366461 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:38.473219 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-81adf44a-d350-4173-9b02-ed7999f5adeb req-e9f7f3ec-78de-41b6-b777-16e8e0366461 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:38.484977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-81adf44a-d350-4173-9b02-ed7999f5adeb req-e9f7f3ec-78de-41b6-b777-16e8e0366461 service nova] Creating event network-vif-plugged:c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5 for instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 on hv-cinder-84456 Sep 28 08:56:38.490004 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-81adf44a-d350-4173-9b02-ed7999f5adeb req-e9f7f3ec-78de-41b6-b777-16e8e0366461 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158058 Sep 28 08:56:38.490589 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 584/1197] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:56:39.096988 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:39.097551 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:39.104626 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:39.105110 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:39.105554 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:39.106228 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:39.106670 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:39.107083 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:39.236060 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:39.243607 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-e5c219a7-27af-4d00-a4db-86db6ea4ab19 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.150521 Sep 28 08:56:39.244164 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 614/1198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:39 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:40.267294 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:40.267997 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:40.275809 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:40.276272 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:40.276761 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:40.277774 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:40.278330 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:40.278839 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:40.411026 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:40.418977 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-5f51250e-9c82-4e57-9d4b-e338bbb1972d tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1265 microversion: 2.1 time: 0.156549 Sep 28 08:56:40.419538 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 585/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:40 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:41.442050 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:41.442698 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:41.449599 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:41.450082 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:41.450519 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:41.451208 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:41.451662 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:41.452087 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:41.583919 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:41.592355 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-4b1a43df-47de-4d9b-9802-55eb24aef199 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1451 microversion: 2.1 time: 0.154168 Sep 28 08:56:41.592922 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 615/1200] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:41 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:56:41.614353 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:56:41.614966 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:56:41.621263 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:41.621741 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:41.622173 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:41.622860 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:41.623310 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:41.623730 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:41.749021 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:56:41.757146 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f524608b-15b0-4fb8-ba84-e96dc72c22bc tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1451 microversion: 2.1 time: 0.146127 Sep 28 08:56:41.757710 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 586/1201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:56:41 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:56:43.394725 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-f307b071-adb1-4867-af89-7c662ff43a5e req-2cd77bcb-face-40ec-a095-13f74304fff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dbd7df-d98c-4eb4-a0cd-c2be66607c84", "tag": "c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:56:43.404388 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-f307b071-adb1-4867-af89-7c662ff43a5e req-2cd77bcb-face-40ec-a095-13f74304fff0 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:56:43.404856 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-f307b071-adb1-4867-af89-7c662ff43a5e req-2cd77bcb-face-40ec-a095-13f74304fff0 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:56:43.405303 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-f307b071-adb1-4867-af89-7c662ff43a5e req-2cd77bcb-face-40ec-a095-13f74304fff0 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:56:43.416127 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-f307b071-adb1-4867-af89-7c662ff43a5e req-2cd77bcb-face-40ec-a095-13f74304fff0 service nova] Creating event network-changed:c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5 for instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 on hv-cinder-84456 Sep 28 08:56:43.421609 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-f307b071-adb1-4867-af89-7c662ff43a5e req-2cd77bcb-face-40ec-a095-13f74304fff0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030461 Sep 28 08:56:43.422368 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 616/1202] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:58:33.567113 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a2ff17dd-88b7-4ac8-aa9e-883fa3b705ef] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 28 08:58:33.567947 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:33.568329 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:33.568877 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG dbcounter [-] [127111] Writing DB stats nova_cell1:SELECT=54 {{(pid=127111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:33.569940 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:33.570308 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 28 08:58:33.573259 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR oslo.messaging._drivers.impl_rabbit [-] [40f2a7fa-476f-4597-94fb-fd7aa8c3f4a8] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 28 08:58:33.573855 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_api:SELECT=22 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:33.574559 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG dbcounter [-] [127110] Writing DB stats nova_cell1:SELECT=50 {{(pid=127110) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 28 08:58:33.576261 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 28 08:58:33.577372 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [req-2a7d5899-f891-4b9f-8a50-c52acfc7b9e4 req-67bfd6f9-66ba-487c-9d0a-8785713fa60d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dbd7df-d98c-4eb4-a0cd-c2be66607c84", "tag": "c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5"}]} {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:58:33.583822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:33.583822 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:33.584278 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:33.585006 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:33.585506 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:33.585955 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:33.588398 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-2a7d5899-f891-4b9f-8a50-c52acfc7b9e4 req-67bfd6f9-66ba-487c-9d0a-8785713fa60d service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:33.588916 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-2a7d5899-f891-4b9f-8a50-c52acfc7b9e4 req-67bfd6f9-66ba-487c-9d0a-8785713fa60d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:33.589430 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [req-2a7d5899-f891-4b9f-8a50-c52acfc7b9e4 req-67bfd6f9-66ba-487c-9d0a-8785713fa60d service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:33.602293 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.compute.server_external_events [req-2a7d5899-f891-4b9f-8a50-c52acfc7b9e4 req-67bfd6f9-66ba-487c-9d0a-8785713fa60d service nova] Creating event network-changed:c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5 for instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 on hv-cinder-84456 Sep 28 08:58:33.607591 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [req-2a7d5899-f891-4b9f-8a50-c52acfc7b9e4 req-67bfd6f9-66ba-487c-9d0a-8785713fa60d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042107 Sep 28 08:58:33.608452 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 617/1203] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:58:33.612105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Going to try to terminate instance {{(pid=127110) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:58:33.695461 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-9b8420d6-7881-491d-a351-5ef0ad0acd84 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 204 len: 0 microversion: 2.1 time: 0.131974 Sep 28 08:58:33.701210 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 587/1204] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:58:33 2022] DELETE /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:58:33.705637 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:33.706702 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:33.713995 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:33.714479 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:33.714909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:33.715601 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:33.716047 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:33.716467 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:33.936478 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:58:33.945386 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-d77b1c1b-387d-4e1e-a884-0f1144f16500 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1576 microversion: 2.1 time: 0.244557 Sep 28 08:58:33.946249 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 618/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:33 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:58:34.969866 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:34.970573 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:34.978713 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:34.979218 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:34.979636 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:34.980332 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:34.980780 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:34.981236 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:34.997539 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO oslo.messaging._drivers.impl_rabbit [-] [40f2a7fa-476f-4597-94fb-fd7aa8c3f4a8] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58480. Sep 28 08:58:35.161659 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:58:35.170103 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-26a0ba88-ea09-4c12-9497-915beebfce40 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1576 microversion: 2.1 time: 0.204490 Sep 28 08:58:35.170663 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 588/1206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:34 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:58:36.192751 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:36.194040 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:36.197277 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-8b0dd568-8364-4e17-93cd-73c98ad74aa4 req-af19f4f6-cfc3-4714-9eea-5d151656977e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dbd7df-d98c-4eb4-a0cd-c2be66607c84", "name": "network-vif-deleted", "tag": "c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:58:36.202097 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:36.202689 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:36.203587 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:36.204331 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:36.204779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:36.205234 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:36.211906 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO oslo.messaging._drivers.impl_rabbit [-] [a2ff17dd-88b7-4ac8-aa9e-883fa3b705ef] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58488. Sep 28 08:58:36.213041 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-8b0dd568-8364-4e17-93cd-73c98ad74aa4 req-af19f4f6-cfc3-4714-9eea-5d151656977e service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:36.214538 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-8b0dd568-8364-4e17-93cd-73c98ad74aa4 req-af19f4f6-cfc3-4714-9eea-5d151656977e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:36.214989 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-8b0dd568-8364-4e17-93cd-73c98ad74aa4 req-af19f4f6-cfc3-4714-9eea-5d151656977e service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:36.238080 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-8b0dd568-8364-4e17-93cd-73c98ad74aa4 req-af19f4f6-cfc3-4714-9eea-5d151656977e service nova] Creating event network-vif-deleted:c19ae89d-6dd0-4bf8-87a9-a1d18548f2b5 for instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 on hv-cinder-84456 Sep 28 08:58:36.245343 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-8b0dd568-8364-4e17-93cd-73c98ad74aa4 req-af19f4f6-cfc3-4714-9eea-5d151656977e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052111 Sep 28 08:58:36.245943 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 589/1207] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 28 08:58:36.271810 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:58:36.281566 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-a1f4bf9b-8284-42ff-87a0-5cb30c2bc45b tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 200 len: 1389 microversion: 2.1 time: 0.092933 Sep 28 08:58:36.282451 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 619/1208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:36 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 1389 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:58:37.307110 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:37.307748 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 35dbd7df-d98c-4eb4-a0cd-c2be66607c84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:37.314313 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:37.314791 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:37.315222 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:37.315904 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:37.316351 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:37.316773 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:37.330105 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] HTTP exception thrown: Instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 could not be found. Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Request method failure captured: Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 HTTP/1.1 Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNArPya-LCUrgz4WB6zeWIABWOUmZdZYJyKT2DW-JW4cycNSG1CVxC1TlVpjqeIrs7w1K35Y1ShAVmUm1rXr8YL6j87Rv2OQdnKN9K2qSTW3l-nMQJgHsDfJ6bUvJL5-e5_VafL_--hOISt7tJT3CS8F7bl6Q_6deXA_D5GirDayepMA Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:58:37.331690 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba777b9726e944a881c0953e605f7477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba777b9726e944a881c0953e605f7477", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: e4ecba03d9254112b343f36ade20754f Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 could not be found. Sep 28 08:58:37.333536 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '35dbd7df-d98c-4eb4-a0cd-c2be66607c84'} Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 could not be found. Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:58:37.334627 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 could not be found. Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 could not be found. Sep 28 08:58:37.336333 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:37.338137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Returning 404 to user: Instance 35dbd7df-d98c-4eb4-a0cd-c2be66607c84 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:58:37.338137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-f4d02d51-d1db-4d39-adf9-d3737883e329 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84" status: 404 len: 111 microversion: 2.1 time: 0.030761 Sep 28 08:58:37.338137 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 590/1209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:37 2022] GET /compute/v2.1/servers/35dbd7df-d98c-4eb4-a0cd-c2be66607c84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:58:40.389831 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:40.390319 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:40.392595 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-f0ad800c-904a-47a2-b2cc-59e19341e61b req-32c7d647-db88-4e60-b09f-24058fe09a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee37495f-3dd5-465d-bbc6-d65a573b6e84", "tag": "7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:58:40.397529 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:40.398217 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:40.398651 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:40.399338 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:40.399779 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:40.400479 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:40.403350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-f0ad800c-904a-47a2-b2cc-59e19341e61b req-32c7d647-db88-4e60-b09f-24058fe09a36 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:40.404079 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-f0ad800c-904a-47a2-b2cc-59e19341e61b req-32c7d647-db88-4e60-b09f-24058fe09a36 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:40.404725 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-f0ad800c-904a-47a2-b2cc-59e19341e61b req-32c7d647-db88-4e60-b09f-24058fe09a36 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:40.418030 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-f0ad800c-904a-47a2-b2cc-59e19341e61b req-32c7d647-db88-4e60-b09f-24058fe09a36 service nova] Creating event network-changed:7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760 for instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 on hv-cinder-84456 Sep 28 08:58:40.423357 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-f0ad800c-904a-47a2-b2cc-59e19341e61b req-32c7d647-db88-4e60-b09f-24058fe09a36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034762 Sep 28 08:58:40.423974 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 591/1210] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:58:40.427909 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Going to try to terminate instance {{(pid=127111) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 28 08:58:40.520279 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2d77addd-3fab-4782-a14b-3ef892f0c5e0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 204 len: 0 microversion: 2.1 time: 0.134058 Sep 28 08:58:40.526034 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 620/1211] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:58:40 2022] DELETE /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 28 08:58:40.534490 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:40.536126 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:40.543250 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:40.543737 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:40.544170 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:40.544865 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:40.545350 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:40.545770 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:40.675661 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.policy [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127110) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:58:40.683368 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-d41d28b9-a038-449c-ae90-9f4d2b2cb4b0 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1578 microversion: 2.1 time: 0.153052 Sep 28 08:58:40.683928 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 592/1212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:40 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:58:41.707014 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:41.707759 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:41.714574 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:41.715062 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:41.715501 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:41.716195 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:41.716649 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:41.717071 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:41.856112 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:58:41.863931 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-8a589fc0-1068-441a-bda3-28c4cf4fddc8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1578 microversion: 2.1 time: 0.161134 Sep 28 08:58:41.864498 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 621/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:41 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 28 08:58:42.859463 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [req-129ea08c-8245-4f51-a8e3-e5f9d1a0d2cf req-7007070c-2af0-4002-b668-65d37c57ed59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee37495f-3dd5-465d-bbc6-d65a573b6e84", "name": "network-vif-deleted", "tag": "7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760"}]} {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 28 08:58:42.872000 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-129ea08c-8245-4f51-a8e3-e5f9d1a0d2cf req-7007070c-2af0-4002-b668-65d37c57ed59 service nova] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:42.872472 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-129ea08c-8245-4f51-a8e3-e5f9d1a0d2cf req-7007070c-2af0-4002-b668-65d37c57ed59 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:42.875931 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [req-129ea08c-8245-4f51-a8e3-e5f9d1a0d2cf req-7007070c-2af0-4002-b668-65d37c57ed59 service nova] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:42.888349 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:42.888942 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:42.892624 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.compute.server_external_events [req-129ea08c-8245-4f51-a8e3-e5f9d1a0d2cf req-7007070c-2af0-4002-b668-65d37c57ed59 service nova] Creating event network-vif-deleted:7a14f7f4-1a84-4a00-81c8-5bdbc2fcb760 for instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 on hv-cinder-84456 Sep 28 08:58:42.895908 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:42.896393 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:42.897447 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:42.898100 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [req-129ea08c-8245-4f51-a8e3-e5f9d1a0d2cf req-7007070c-2af0-4002-b668-65d37c57ed59 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042693 Sep 28 08:58:42.898224 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:42.898581 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:42.898696 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 593/1214] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Sep 28 08:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 28 08:58:42.899004 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:42.967559 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.policy [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4ecba03d9254112b343f36ade20754f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba777b9726e944a881c0953e605f7477', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127111) authorize /opt/stack/nova/nova/policy.py:199}} Sep 28 08:58:42.975268 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-198c3c09-1d15-48f4-80f3-44b026d76f25 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 200 len: 1225 microversion: 2.1 time: 0.090828 Sep 28 08:58:42.975848 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 622/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:42 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 28 08:58:43.999208 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:43.999913 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: ee37495f-3dd5-465d-bbc6-d65a573b6e84] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:44.006775 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:44.007256 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:44.007694 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:44.008385 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:44.008841 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:44.009308 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:44.022291 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] HTTP exception thrown: Instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 could not be found. Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Request method failure captured: Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 HTTP/1.1 Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNArPya-LCUrgz4WB6zeWIABWOUmZdZYJyKT2DW-JW4cycNSG1CVxC1TlVpjqeIrs7w1K35Y1ShAVmUm1rXr8YL6j87Rv2OQdnKN9K2qSTW3l-nMQJgHsDfJ6bUvJL5-e5_VafL_--hOISt7tJT3CS8F7bl6Q_6deXA_D5GirDayepMA Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:58:44.023887 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba777b9726e944a881c0953e605f7477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba777b9726e944a881c0953e605f7477", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: e4ecba03d9254112b343f36ade20754f Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 could not be found. Sep 28 08:58:44.025615 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': 'ee37495f-3dd5-465d-bbc6-d65a573b6e84'} Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 could not be found. Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:58:44.026468 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 could not be found. Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 could not be found. Sep 28 08:58:44.027875 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.029231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Returning 404 to user: Instance ee37495f-3dd5-465d-bbc6-d65a573b6e84 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:58:44.029231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-93c98f90-42c1-41c8-83ba-f93a584a7ff3 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84" status: 404 len: 111 microversion: 2.1 time: 0.030882 Sep 28 08:58:44.029231 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 594/1216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:43 2022] GET /compute/v2.1/servers/ee37495f-3dd5-465d-bbc6-d65a573b6e84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 28 08:58:44.451344 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:44.451834 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.compute.api [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127111) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:44.458511 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:44.458985 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:44.459415 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:44.460101 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:44.460547 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:44.460967 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG oslo_concurrency.lockutils [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:44.473925 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.wsgi [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] HTTP exception thrown: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Request method failure captured: Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: request: DELETE /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 HTTP/1.1 Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept: application/json Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Accept-Encoding: identity Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Connection: close Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Length: 0 Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Content-Type: application/json Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Host: 10.222.0.52 Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: Openstack-System-Scope: None Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: User-Agent: python-urllib3/1.26.12 Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Auth-Token: gAAAAABjNArPya-LCUrgz4WB6zeWIABWOUmZdZYJyKT2DW-JW4cycNSG1CVxC1TlVpjqeIrs7w1K35Y1ShAVmUm1rXr8YL6j87Rv2OQdnKN9K2qSTW3l-nMQJgHsDfJ6bUvJL5-e5_VafL_--hOISt7tJT3CS8F7bl6Q_6deXA_D5GirDayepMA Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Id: None Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Domain-Name: None Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Identity-Status: Confirmed Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Is-Admin-Project: True Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Id: default Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Domain-Name: Default Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Project-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Role: member,reader Sep 28 08:58:44.476055 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Roles: member,reader Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba777b9726e944a881c0953e605f7477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba777b9726e944a881c0953e605f7477", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Id: default Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Domain-Name: Default Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Id: e4ecba03d9254112b343f36ade20754f Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: X-User-Name: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: method: > Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: exception: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.477820 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: action_args: {'id': '71898013-5f2c-4fe1-95e5-ca068eece196'} Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:58:44.478981 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.480745 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.482369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Returning 404 to user: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. {{(pid=127111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:58:44.482369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-7fa9e9ea-6dfb-4526-8a6f-eac53302dd9e tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "DELETE /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 404 len: 111 microversion: 2.1 time: 0.030213 Sep 28 08:58:44.482369 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 623/1217] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Sep 28 08:58:44 2022] DELETE /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:58:44.485892 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '>' {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:44.486492 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.compute.api [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] [instance: 71898013-5f2c-4fe1-95e5-ca068eece196] Fetching instance by UUID {{(pid=127110) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 28 08:58:44.492876 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:44.493374 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:44.493800 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:44.494477 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Acquiring lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 28 08:58:44.494922 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 28 08:58:44.495339 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG oslo_concurrency.lockutils [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Lock "2e2a57ab-fab2-4986-9c64-da0c4216fc01" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 28 08:58:44.508274 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.wsgi [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] HTTP exception thrown: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Request method failure captured: Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: request: GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 HTTP/1.1 Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept: application/json Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Accept-Encoding: identity Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Connection: close Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Length: 0 Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Content-Type: application/json Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Host: 10.222.0.52 Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: Openstack-System-Scope: None Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: User-Agent: python-urllib3/1.26.12 Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Auth-Token: gAAAAABjNArPya-LCUrgz4WB6zeWIABWOUmZdZYJyKT2DW-JW4cycNSG1CVxC1TlVpjqeIrs7w1K35Y1ShAVmUm1rXr8YL6j87Rv2OQdnKN9K2qSTW3l-nMQJgHsDfJ6bUvJL5-e5_VafL_--hOISt7tJT3CS8F7bl6Q_6deXA_D5GirDayepMA Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Id: None Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Domain-Name: None Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Identity-Status: Confirmed Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Is-Admin-Project: True Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Id: default Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Domain-Name: Default Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Project-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Role: member,reader Sep 28 08:58:44.509789 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Roles: member,reader Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba777b9726e944a881c0953e605f7477"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba777b9726e944a881c0953e605f7477"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba777b9726e944a881c0953e605f7477", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}] Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Id: ba777b9726e944a881c0953e605f7477 Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-Tenant-Name: tempest-TestVolumeBootPattern-1509163950 Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Id: default Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Domain-Name: Default Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Id: e4ecba03d9254112b343f36ade20754f Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: X-User-Name: tempest-TestVolumeBootPattern-1509163950-project Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: method: > Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: exception: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.511540 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: action_args: {'id': '71898013-5f2c-4fe1-95e5-ca068eece196'} Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: {{(pid=127110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 28 08:58:44.512500 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. Sep 28 08:58:44.513983 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: ERROR nova.api.openstack.wsgi Sep 28 08:58:44.515180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: DEBUG nova.api.openstack.wsgi [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Returning 404 to user: Instance 71898013-5f2c-4fe1-95e5-ca068eece196 could not be found. {{(pid=127110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 28 08:58:44.515180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: INFO nova.api.openstack.requestlog [None req-ccda3bf3-7297-4694-8097-98d7051325b8 tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196" status: 404 len: 111 microversion: 2.1 time: 0.029060 Sep 28 08:58:44.515180 dv-cinder-844563-8-iscsi devstack@n-api.service[127110]: [pid: 127110|app: 0|req: 595/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Sep 28 08:58:44 2022] GET /compute/v2.1/servers/71898013-5f2c-4fe1-95e5-ca068eece196 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 28 08:58:45.804194 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: DEBUG nova.api.openstack.wsgi [None req-2e59f6da-0f4d-4117-ad19-ad8b35e508cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] Calling method '.version_select at 0x7f984fd52c10>' {{(pid=127111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 28 08:58:45.827903 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: INFO nova.api.openstack.requestlog [None req-2e59f6da-0f4d-4117-ad19-ad8b35e508cd tempest-TestVolumeBootPattern-1509163950 tempest-TestVolumeBootPattern-1509163950-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-215678673" status: 202 len: 0 microversion: 2.1 time: 0.027481 Sep 28 08:58:45.828653 dv-cinder-844563-8-iscsi devstack@n-api.service[127111]: [pid: 127111|app: 0|req: 624/1219] 10.222.0.52 () {58 vars in 1260 bytes} [Wed Sep 28 08:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-215678673 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)